-- Logs begin at Fri 2022-01-28 00:43:45 UTC, end at Fri 2022-01-28 01:43:02 UTC. -- Jan 28 01:16:39.237160 dv-cinder-826623-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 01:16:39.246195 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:16:39 2022] *** Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: nodename: dv-cinder-826623-2-iscsi Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: machine: x86_64 Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: clock source: unix Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: pcre jit disabled Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: detected number of CPU cores: 4 Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: current working directory: / Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: your processes number limit is 47680 Jan 28 01:16:39.248222 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: your memory page size is 4096 bytes Jan 28 01:16:39.248989 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: detected max file descriptor number: 2048 Jan 28 01:16:39.248989 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: lock engine: pthread robust mutexes Jan 28 01:16:39.248989 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: thunder lock: enabled Jan 28 01:16:39.248989 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 01:16:39.248989 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:16:39.293077 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: Python main interpreter initialized at 0x55fbc6d4a9c0 Jan 28 01:16:39.293077 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: python threads support enabled Jan 28 01:16:39.293077 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: your server socket listen backlog is limited to 100 connections Jan 28 01:16:39.293077 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:16:39.293442 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:16:39.293517 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: *** Operational MODE: preforking *** Jan 28 01:16:39.293749 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:16:39.293749 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: spawned uWSGI master process (pid: 101711) Jan 28 01:16:39.293956 dv-cinder-826623-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 01:16:39.295460 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: spawned uWSGI worker 1 (pid: 101712, cores: 1) Jan 28 01:16:39.295460 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: spawned uWSGI worker 2 (pid: 101713, cores: 1) Jan 28 01:16:39.295460 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:16:41.051977 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:16:41.051977 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: from cryptography.utils import int_from_bytes Jan 28 01:16:41.052693 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:16:41.052693 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: from cryptography.utils import int_from_bytes Jan 28 01:16:41.053111 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:16:41.053111 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: from cryptography.utils import int_from_bytes Jan 28 01:16:41.053219 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:16:41.053219 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: from cryptography.utils import int_from_bytes Jan 28 01:16:43.602318 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:16:43.602904 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:16:43.603023 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:16:43.603421 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:16:43.603566 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:16:43.603928 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:16:43.604008 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:16:43.604082 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.604225 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:16:43.604368 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.604555 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:16:43.604663 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.604797 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:16:43.604885 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.605250 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.605400 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.605535 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.605628 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.605845 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.605953 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.606188 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.606335 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.606512 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.606640 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.606738 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.606817 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607055 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607202 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607373 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826623-2-iscsi {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607515 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607683 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607836 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.607923 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608000 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608265 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608394 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608548 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826623-2-iscsi {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608665 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608844 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.608988 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.609156 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.609270 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.609475 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.609578 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.609787 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.609965 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.610072 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.610386 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.610484 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.610694 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.610783 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611005 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611190 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611355 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611508 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611647 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611792 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.611938 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.612079 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.612247 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.612405 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.612552 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.612715 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.612861 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.613017 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.613172 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.613360 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.613565 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826623-2-iscsi {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.613659 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.613878 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.614084 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.614277 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.614469 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.614704 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615047 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826623-2-iscsi {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615305 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615530 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615743 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615843 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615917 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.615988 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616141 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616141 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616270 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616400 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616555 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616763 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.616890 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617028 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617120 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617367 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617476 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617673 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617760 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.617964 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618060 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618274 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618369 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618574 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618669 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618885 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.618975 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.619186 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.619280 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.619475 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.619574 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.619703 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.619790 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620021 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620110 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620328 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620426 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620643 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620742 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.620881 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621014 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621178 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621351 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621484 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621612 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621734 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.621852 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622058 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622195 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622325 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622445 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622571 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622706 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.622900 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623027 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623203 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623333 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623506 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623668 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623841 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.623940 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.624156 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.624259 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.624401 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.624495 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.624698 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.624794 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625000 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625088 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625321 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625429 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625625 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625715 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.625935 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626022 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626245 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626355 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626554 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626641 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626856 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.626950 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.627171 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.627267 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.627481 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.627576 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.627784 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.627873 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628547 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628631 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628631 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628767 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628831 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628904 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.628974 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629039 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629278 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629374 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629586 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629685 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629898 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.629981 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.630202 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.630286 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.630470 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.630553 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.630769 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.630859 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631070 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631156 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631382 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631470 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631681 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631774 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.631979 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632062 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632278 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632370 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632572 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632656 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632871 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.632955 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.633172 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.633271 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.633503 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.633587 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.633805 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.633899 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.634114 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.634213 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.634416 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.634511 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.634709 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.634801 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635018 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635106 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635329 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635421 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635636 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635731 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.635938 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636021 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636234 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636323 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636532 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636623 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636829 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.636912 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.637126 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.637254 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.637455 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.637551 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.637754 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.637837 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638051 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638134 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638347 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638443 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638661 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638745 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.638960 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639042 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639260 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639353 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639559 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639649 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639856 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.639939 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.640156 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.640316 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.640450 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.640533 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.640750 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.640834 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641050 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641134 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641370 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641512 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641668 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641754 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.641962 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642044 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642261 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642345 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642559 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642640 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642856 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.642940 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.643152 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.643234 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.643448 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.643529 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.643749 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.643833 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644042 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644125 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644341 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644437 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644655 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644748 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.644945 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645028 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645265 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645364 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645580 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645664 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645886 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.645967 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.646244 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.646351 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.646543 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.646627 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.646856 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:16:43.646938 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.647187 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.647283 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.647513 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.647596 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.647824 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.647907 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.648136 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.648220 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.648449 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.648570 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.648766 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.648856 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.649071 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.649158 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.649400 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.649499 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.649705 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.649864 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650016 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650101 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650321 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650403 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650630 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650712 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.650937 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651020 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651253 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651356 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651566 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651657 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651868 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.651951 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.652178 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.652267 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.652486 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.652568 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.652803 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.652895 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.653105 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.653194 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.653437 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.653530 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.653761 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.653845 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.654077 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.654159 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.654380 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.654470 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.654692 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.654798 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655011 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655112 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655326 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655446 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655637 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655741 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.655944 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.656032 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.656269 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.656365 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.656572 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.656673 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.656904 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657006 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657189 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657295 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657551 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657637 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657856 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.657942 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.658160 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.658252 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.658460 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.658687 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.658820 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.658957 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659102 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659234 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659365 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659495 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659634 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659771 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.659940 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660069 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660235 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660367 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660536 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660679 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660844 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.660975 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.661148 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.661304 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.661475 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.661572 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.661838 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.661926 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.662139 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.662229 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.662442 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.662610 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.662746 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.662830 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663045 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663132 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663354 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663448 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663657 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663739 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.663955 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664038 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664254 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664338 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664561 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664665 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664856 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.664941 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.665159 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.665268 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.665490 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.665572 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.665794 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.665875 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.666094 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.666179 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.666402 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.666493 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.666702 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.666784 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667002 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667086 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667309 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667398 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667643 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667733 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.667942 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668032 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668243 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668325 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668573 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668672 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668881 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.668967 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.669176 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.669288 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.669507 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.669603 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.669805 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.669902 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670099 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670183 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670397 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670497 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670700 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670783 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.670998 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671080 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671293 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671376 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671587 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671676 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671882 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.671964 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.672176 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.672267 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.672472 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.672583 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.672770 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.672854 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673063 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673146 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673380 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673468 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673675 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673757 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.673986 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.674076 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.674287 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.674370 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.674588 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.674681 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.674885 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675025 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675219 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675302 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675516 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675606 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675822 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.675905 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.676131 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.676223 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.676436 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.676528 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.676737 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.676828 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.677039 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.677122 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.677394 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.677499 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.677702 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.677785 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678003 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678092 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678307 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678398 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678610 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678730 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.678920 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679003 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679218 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679301 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679528 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679611 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679824 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.679909 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.680211 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.680308 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.680436 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.680526 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.680748 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.680832 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681047 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681139 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681379 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681466 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681678 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681771 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.681983 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682070 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682286 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682369 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682588 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682685 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682887 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.682969 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.683189 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.683272 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.683495 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.683587 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.683792 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.683874 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.684091 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.684186 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.684390 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.684482 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.684701 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.684792 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685001 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685137 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685333 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685432 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685630 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685719 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.685935 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686019 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686235 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686326 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686551 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686634 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686846 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.686930 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.687145 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.687229 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.687457 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.687541 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.687758 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.687841 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688061 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688145 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688363 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688445 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688658 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688739 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.688955 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689087 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689276 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689409 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689583 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689666 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689881 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.689964 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.690177 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.690258 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.690470 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.690629 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.690777 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.690869 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691077 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691160 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691371 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691463 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691663 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691754 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.691963 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692093 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692264 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692355 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692560 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692643 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692866 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.692979 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.693215 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.693386 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.693551 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.693686 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.693856 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.693982 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.694174 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.694294 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.694497 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.694582 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.694798 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.694883 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.695096 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.695223 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.695411 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.695494 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.695714 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.695798 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696012 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696103 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696310 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696393 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696610 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696693 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.696928 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697012 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697255 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697353 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697561 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697653 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697868 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.697951 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.698178 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.698272 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.698491 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.698591 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.698796 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.698880 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.699103 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.699184 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.699403 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.699493 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.699706 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.699796 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700009 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700099 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700308 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700398 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700614 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700697 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700913 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.700994 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.701213 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.701353 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.701536 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.701620 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.701832 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.701917 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.702134 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.702217 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.702432 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.702514 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.702735 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703006 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703103 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703319 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703400 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703625 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703706 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.703939 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.704184 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.704269 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.704522 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.704605 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.704836 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.704928 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.705153 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.705303 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.705493 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.705577 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.705788 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.705887 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.706097 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.706182 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.706398 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.706480 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.706696 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.706794 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707001 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707092 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707302 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707385 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707599 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707689 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707895 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.707976 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.708200 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.708282 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.708516 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.708611 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.708820 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.708907 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.709122 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.709277 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.709446 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.709540 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.709789 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.709874 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.710093 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.710176 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.710398 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.710515 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.710696 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.710798 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711017 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711100 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711316 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711401 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711611 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711695 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711907 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.711991 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.712203 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.712286 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.712511 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.712601 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.712809 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.712893 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.713106 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.713189 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.713428 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.713515 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.713765 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.713848 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714065 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714147 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714359 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714470 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714675 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714759 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.714971 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715062 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715267 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715387 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715561 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715645 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715863 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.715955 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.716165 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.716256 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.716458 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.716544 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.716752 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.716842 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717049 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717145 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717374 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717460 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717674 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717769 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.717969 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.718053 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.718269 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.718373 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.718563 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.718957 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.719176 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.719266 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.719474 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.719557 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.719765 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.719848 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720058 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720148 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720359 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720443 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720659 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720743 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.720951 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721033 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721270 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721358 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721561 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721645 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721864 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.721954 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.722159 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.722251 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.722454 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.722548 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.722747 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.722830 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723046 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723136 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723345 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723427 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723637 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723719 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.723929 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724021 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724290 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724377 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724597 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724686 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724893 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.724985 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.725196 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.725294 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.725515 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.725599 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.725812 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.725897 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.726108 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.726191 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.726415 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.726500 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.726713 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.726798 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727083 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727179 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727308 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727391 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727602 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727686 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727897 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.727981 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.728196 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.728278 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.728498 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.728590 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.728791 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.728874 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729083 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729176 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729403 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729489 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729698 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729788 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.729997 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730089 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730297 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730379 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730594 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730677 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730887 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.730978 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.731182 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.731266 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.731478 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.731562 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.731782 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.731873 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.732079 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.732163 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.732374 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.732457 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.732708 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.732792 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733015 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733098 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733352 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733451 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733661 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733747 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.733963 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734054 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734270 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734353 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734566 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734650 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734872 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.734956 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.735172 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.735264 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.735480 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.735611 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.735774 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.735858 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736068 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736151 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736369 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736462 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736669 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736758 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.736962 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737055 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737282 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737370 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737594 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737680 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737896 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.737987 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.738194 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.738284 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.738498 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.738581 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.738799 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.738892 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.739100 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.739183 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.739395 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.739477 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.739717 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.739812 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740021 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740111 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740322 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740404 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740624 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740707 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.740923 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741004 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741242 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741329 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741541 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741633 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741843 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.741925 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.742144 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.742234 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.742443 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.742529 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.742741 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.742830 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743046 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743132 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743340 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743430 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743636 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743725 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.743933 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744024 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744237 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744327 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744535 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744626 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744841 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.744936 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.745142 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.745250 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.745473 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.745561 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.745776 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.745884 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.746144 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.746228 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.746457 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.746548 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.746766 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.746859 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747063 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747161 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747360 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747443 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747668 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747773 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.747988 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.748072 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.748298 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.748382 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.748599 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.748691 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.748951 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749036 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749283 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749370 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749578 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749664 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749897 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.749982 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.750195 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.750278 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.750490 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.750574 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.750783 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.750864 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751096 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751192 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751393 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751474 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751691 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751780 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.751990 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.752082 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.752308 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.752392 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.752612 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.752695 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.752926 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.753078 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.753369 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.753456 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.753682 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.753767 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.753985 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.754080 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.754307 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.754390 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.754625 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.754716 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.754932 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.755033 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.755247 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.755375 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.755607 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.755698 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.755926 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756017 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756241 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756330 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756544 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756626 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756849 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.756931 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.757144 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.757252 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.757485 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.757570 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.757787 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.757878 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.758098 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.758181 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.758398 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.758489 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.758713 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.758796 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.759028 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.759110 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.759335 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.759441 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.759648 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.759794 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760000 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760083 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760299 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760382 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760596 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760692 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760902 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.760992 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.761201 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.761392 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.761523 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.761625 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.761841 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.761923 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.762137 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.762218 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.762443 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.762535 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.762744 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.762827 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763045 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763127 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763344 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763428 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763640 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763732 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.763942 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764031 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764239 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764322 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764541 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764623 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764840 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.764923 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.765150 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.765251 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.765470 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.765552 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.765783 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.765906 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766092 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766183 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766396 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766488 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766697 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766790 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.766996 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767080 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767294 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767379 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767602 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767692 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767903 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.767986 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.768202 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.768285 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.768500 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.768592 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.768834 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.768918 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.769134 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.769266 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.769475 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.769572 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.769794 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.769877 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.770104 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.770188 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.770408 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.770492 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.770723 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.770805 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771045 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771134 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771343 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771428 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771649 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771731 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.771947 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772030 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772245 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772336 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772543 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772632 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772846 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.772936 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.773141 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.773251 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.773460 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.773544 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.773756 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.773851 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774064 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774147 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774359 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774442 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774652 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774743 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.774949 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775046 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775244 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775328 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775541 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775646 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775835 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.775924 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.776175 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.776268 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.776464 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.776557 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.776761 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.776844 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.777065 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.777149 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.777413 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.777499 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.777710 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.777791 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778021 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778103 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778332 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778416 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778640 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778723 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.778947 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779030 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779253 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779336 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779557 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779639 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779865 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.779993 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.780171 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.780256 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.780478 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.780569 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.780779 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.780906 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.781085 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.781167 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.781413 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.781497 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.781723 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.781818 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782030 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782227 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782340 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782549 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782639 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782858 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.782943 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.783165 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.783439 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.783525 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.783759 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.783852 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784060 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784143 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784366 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784449 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784671 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784763 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.784972 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785055 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785297 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785383 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785604 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785688 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785911 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.785998 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.786220 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.786304 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.786525 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.786657 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.786888 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.786979 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.787196 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.787290 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.787503 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.787588 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.787811 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.787895 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.788133 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.788260 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.788444 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.788528 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.788752 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.788834 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.789059 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.789151 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.789434 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.789542 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.789745 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.789829 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790045 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790130 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790350 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790432 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790657 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790749 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.790962 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791046 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791267 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791357 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791570 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791666 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791875 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.791958 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.792179 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.792262 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.792486 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.792594 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.792793 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.792884 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.793104 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.793197 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.793437 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.793531 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.793746 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.793830 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794059 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794142 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794380 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794563 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794689 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794871 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.794998 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.795196 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.795311 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.795516 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.795815 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.795900 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.796126 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.796249 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.796445 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.796529 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.796757 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.796856 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797053 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797145 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797375 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797464 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797684 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797784 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.797990 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798082 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798291 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798382 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798593 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798677 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798898 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.798989 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.799203 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.799288 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.799501 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.799585 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.799808 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.799900 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.800111 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.800328 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.800412 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.800668 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.800762 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.800979 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.801062 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.801317 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.801542 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.801626 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.801886 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.801970 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.802222 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.802309 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.802545 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.802628 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.802843 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.802927 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.803143 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.803234 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.803451 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.803545 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.803757 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.803840 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804055 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804138 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804355 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804451 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804661 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804745 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.804966 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805055 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805283 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805379 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805588 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805671 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805888 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.805970 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.806193 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.806324 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.806494 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.806577 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.806794 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.806877 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807091 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807175 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807393 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807475 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807692 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807776 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.807991 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.808076 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.808287 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.808370 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.808583 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.808673 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.808931 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809031 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809166 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809288 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809488 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809573 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809784 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.809881 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810087 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810173 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810383 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810466 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810683 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810768 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.810980 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811064 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811282 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811377 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811581 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811665 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811880 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.811963 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.812175 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.812270 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.812482 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.812572 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.812780 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.812863 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.813080 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.813172 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.813407 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.813492 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.813713 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.813795 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.814032 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.814134 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.814347 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.814598 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.814689 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.814931 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.815029 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.815249 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.815341 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.815578 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.815821 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.815912 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.816154 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.816242 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.816471 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.816556 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.816776 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.816866 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.817098 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.817185 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.817421 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.817508 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.817724 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.817841 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.818081 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.818165 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.818404 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.818489 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.818712 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.818809 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819023 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819107 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819328 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819410 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819631 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819722 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.819933 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820017 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820238 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820361 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820541 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820642 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820848 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.820931 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.821154 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.821258 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.821504 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.821597 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.821815 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.821906 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.822129 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.822214 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.822441 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.822528 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.822745 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.822828 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823050 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823133 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823355 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823441 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823657 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823741 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.823966 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824058 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824288 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824373 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824591 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824682 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824886 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.824978 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.825197 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.825337 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.825544 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.825630 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.825855 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.825949 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.826155 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.826239 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.826515 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.826610 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.826829 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.826915 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.827145 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.827239 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.827451 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.827535 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.827755 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.827846 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.828066 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.828156 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.828379 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.828462 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.828712 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.828851 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829031 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829185 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829374 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829519 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829676 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829845 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.829976 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.830180 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.830263 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.830505 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.830590 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.830827 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.830911 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.831129 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.831254 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.831432 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.831518 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.831734 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.831820 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832040 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832136 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832364 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832449 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832668 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832759 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.832982 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.833075 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.833320 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.833408 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.833656 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.833746 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.833962 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.834060 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.834291 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.834375 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.834597 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.834682 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.834902 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835006 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835206 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835291 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835507 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835591 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835810 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.835903 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.836119 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.836204 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.836445 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.836572 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.836753 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.836851 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.837051 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.837136 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.837378 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.837478 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.837694 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.837779 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838004 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838087 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838319 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838412 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838618 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838702 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.838949 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839071 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839250 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839358 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839558 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839644 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839862 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.839954 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.840166 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.840259 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.840474 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.840608 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.840778 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.840862 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.841090 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.841183 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.841417 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.841517 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.841724 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.841820 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842036 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842121 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842350 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842435 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842670 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842756 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.842989 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.843072 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.843308 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.843402 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.843963 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.844061 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.844273 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.844359 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.844574 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.844657 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.844814 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101713) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:16:43.844931 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.845269 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.845592 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.845899 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.846198 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:16:43.846440 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:16:43.868155 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_db.sqlalchemy.engines [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:43.869188 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_db.sqlalchemy.engines [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:43.929840 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.context [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),839f0624-fa55-455e-8eb6-3b061d667ee0(cell1) {{(pid=101713) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:16:43.931101 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.context [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),839f0624-fa55-455e-8eb6-3b061d667ee0(cell1) {{(pid=101712) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:16:43.934197 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:16:43.935469 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_concurrency.lockutils [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:16:43.935774 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:16:43.936575 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:16:43.937084 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_concurrency.lockutils [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:16:43.937909 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_concurrency.lockutils [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:16:43.938524 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:16:43.939832 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_concurrency.lockutils [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:16:43.949380 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_db.sqlalchemy.engines [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:43.952950 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_db.sqlalchemy.engines [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:43.955623 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_db.sqlalchemy.engines [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:43.958309 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_db.sqlalchemy.engines [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:44.125320 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG oslo_db.sqlalchemy.engines [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:44.128196 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_db.sqlalchemy.engines [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101713) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:16:44.459821 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: WARNING keystonemiddleware.auth_token [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:16:44.466507 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: WARNING keystonemiddleware.auth_token [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:16:44.472181 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: WARNING keystonemiddleware.auth_token [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:16:44.478880 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: WARNING keystonemiddleware.auth_token [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:16:44.803679 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: WARNING keystonemiddleware.auth_token [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:16:44.808884 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: WARNING keystonemiddleware.auth_token [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:16:44.814181 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fbc6d4a9c0 pid: 101712 (default app) Jan 28 01:16:44.816280 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:16:44.817505 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Jan 28 01:16:44.817935 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Fri Jan 28 01:16:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:16:44.825279 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: WARNING keystonemiddleware.auth_token [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:16:44.830670 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: WARNING keystonemiddleware.auth_token [None req-97f06ae6-5fe4-4313-96ae-f01dc0433641 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:16:44.836520 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fbc6d4a9c0 pid: 101713 (default app) Jan 28 01:18:10.202464 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:10.203439 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 28 01:18:10.205197 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:10.656415 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-52871e2f-780a-4f97-83f6-d6a6efe6ed1c admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:10.686350 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-52871e2f-780a-4f97-83f6-d6a6efe6ed1c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.475340 Jan 28 01:18:10.697325 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jan 28 01:18:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:12.951404 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:12.952972 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-b32cb011-38f9-4696-954b-ef7024c50288 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 Jan 28 01:18:12.953580 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:13.014892 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-1ed82f3b-6e40-4ffd-ac2a-1e285abc66f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "ram": 256, "disk": 1}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:13.033310 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:18:13.033310 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: warnings.warn(msg) Jan 28 01:18:13.062499 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-1ed82f3b-6e40-4ffd-ac2a-1e285abc66f8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103143 Jan 28 01:18:13.063256 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:18:13.279188 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-2ba4f819-d60b-4c90-856e-3ab5650642c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:13.281621 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:18:13.281621 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: warnings.warn(msg) Jan 28 01:18:13.334216 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-2ba4f819-d60b-4c90-856e-3ab5650642c6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262618 Jan 28 01:18:13.335403 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jan 28 01:18:13 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:15.705884 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-1ed82f3b-6e40-4ffd-ac2a-1e285abc66f8 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:15.706879 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-1ed82f3b-6e40-4ffd-ac2a-1e285abc66f8 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jan 28 01:18:15.707293 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:15.832447 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-f0722502-93e8-41f5-86f2-25babb7bf484 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:15.851676 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:18:15.851676 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: warnings.warn(msg) Jan 28 01:18:15.872456 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-f0722502-93e8-41f5-86f2-25babb7bf484 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.159069 Jan 28 01:18:15.873013 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:18:15.887169 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-436c4fa7-7f2f-41c5-b6bf-84da114dbb31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:15.889006 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:18:15.889006 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: warnings.warn(msg) Jan 28 01:18:15.927229 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-436c4fa7-7f2f-41c5-b6bf-84da114dbb31 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043745 Jan 28 01:18:15.928059 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jan 28 01:18:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:18.175365 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-f0722502-93e8-41f5-86f2-25babb7bf484 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:18.176379 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-f0722502-93e8-41f5-86f2-25babb7bf484 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jan 28 01:18:18.176981 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:18.243735 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-2c16440d-1bb9-4534-828b-4aadc0c5fb99 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "name": "ds1G", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "rxtx_factor": 1.0}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:18.264190 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-2c16440d-1bb9-4534-828b-4aadc0c5fb99 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.081218 Jan 28 01:18:18.265608 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:18:18.278270 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-3c438b1f-5816-4ee1-821c-011c89db41c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:18.304252 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-3c438b1f-5816-4ee1-821c-011c89db41c3 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030882 Jan 28 01:18:18.304930 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jan 28 01:18:18 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:20.528053 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-2c16440d-1bb9-4534-828b-4aadc0c5fb99 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:20.529112 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-2c16440d-1bb9-4534-828b-4aadc0c5fb99 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 28 01:18:20.529599 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:20.588758 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-9e0f932f-dc06-4aad-bb7b-21ea876b8d98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:20.608150 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-9e0f932f-dc06-4aad-bb7b-21ea876b8d98 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072666 Jan 28 01:18:20.612196 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:18:20.624253 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-261004f8-d702-4d49-bd11-013d4f77ee87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:20.647336 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-261004f8-d702-4d49-bd11-013d4f77ee87 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026735 Jan 28 01:18:20.648167 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jan 28 01:18:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:22.903444 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-9e0f932f-dc06-4aad-bb7b-21ea876b8d98 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:22.905025 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-9e0f932f-dc06-4aad-bb7b-21ea876b8d98 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002031 Jan 28 01:18:22.915667 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:22 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:22.977637 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-07ea7b1e-ca51-4803-aa6d-a73e2d35a661 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:23.001142 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-07ea7b1e-ca51-4803-aa6d-a73e2d35a661 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089422 Jan 28 01:18:23.001735 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:18:23.013356 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-17c9a874-b53e-4925-a8eb-ac45da4ab3db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:23.037050 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-17c9a874-b53e-4925-a8eb-ac45da4ab3db admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027206 Jan 28 01:18:23.054052 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1335 bytes} [Fri Jan 28 01:18:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:18:25.246215 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-07ea7b1e-ca51-4803-aa6d-a73e2d35a661 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:25.247228 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-07ea7b1e-ca51-4803-aa6d-a73e2d35a661 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 28 01:18:25.247607 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:25.311113 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-49c843ac-8cc9-400b-a6f5-2cf38b09e9be admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:25.337832 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-49c843ac-8cc9-400b-a6f5-2cf38b09e9be admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083584 Jan 28 01:18:25.338531 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jan 28 01:18:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:18:28.010133 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-07ea7b1e-ca51-4803-aa6d-a73e2d35a661 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:28.011221 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-07ea7b1e-ca51-4803-aa6d-a73e2d35a661 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jan 28 01:18:28.011620 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:28.073859 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-cb7c65a5-7c50-410f-9fdf-af704aa5924e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:28.092683 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-cb7c65a5-7c50-410f-9fdf-af704aa5924e admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075044 Jan 28 01:18:28.093253 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:18:28.105095 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-f45423e4-dc6a-42c9-8125-3463c60f0748 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:28.130695 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-f45423e4-dc6a-42c9-8125-3463c60f0748 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029316 Jan 28 01:18:28.131331 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jan 28 01:18:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:30.889552 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-cb7c65a5-7c50-410f-9fdf-af704aa5924e admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:30.890546 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-cb7c65a5-7c50-410f-9fdf-af704aa5924e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001738 Jan 28 01:18:30.891008 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:30.964654 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-a724d74a-6cf3-439f-ae2c-9d84399dbe68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "swap": 0, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:30.991834 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-a724d74a-6cf3-439f-ae2c-9d84399dbe68 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094245 Jan 28 01:18:30.992811 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:18:31.008635 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-f7694d2b-025e-4690-9d03-fb2baaf3cb91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:31.045652 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-f7694d2b-025e-4690-9d03-fb2baaf3cb91 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041077 Jan 28 01:18:31.046553 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jan 28 01:18:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:33.352312 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-a724d74a-6cf3-439f-ae2c-9d84399dbe68 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:33.353349 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-a724d74a-6cf3-439f-ae2c-9d84399dbe68 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 28 01:18:33.353749 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:33.415651 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-593f24b4-2b70-499a-90fe-c522cd6cf6b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:33.435196 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-593f24b4-2b70-499a-90fe-c522cd6cf6b0 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.075457 Jan 28 01:18:33.435853 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:18:33.447573 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-278bf323-78d7-4f60-bf87-9a1a9dc2ae3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:33.471084 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-278bf323-78d7-4f60-bf87-9a1a9dc2ae3d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027104 Jan 28 01:18:33.471843 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jan 28 01:18:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:35.763965 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-593f24b4-2b70-499a-90fe-c522cd6cf6b0 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:35.765137 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-593f24b4-2b70-499a-90fe-c522cd6cf6b0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Jan 28 01:18:35.765837 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:35.828322 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-e1bb8f94-061d-4207-8522-3a6a5f95f9af admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "disk": 80, "ram": 8192, "id": "4"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:35.902060 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-e1bb8f94-061d-4207-8522-3a6a5f95f9af admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.130173 Jan 28 01:18:35.902954 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:18:35.914539 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-c5369a7a-7e66-4a45-b5f5-4f94afdd903b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:35.936657 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-c5369a7a-7e66-4a45-b5f5-4f94afdd903b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025692 Jan 28 01:18:35.937317 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jan 28 01:18:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:38.158777 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-e1bb8f94-061d-4207-8522-3a6a5f95f9af admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:38.159787 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-e1bb8f94-061d-4207-8522-3a6a5f95f9af admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jan 28 01:18:38.160334 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:18:38.222863 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-6a031859-11fa-4764-989c-3f272ac40574 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "5", "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:38.251517 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-6a031859-11fa-4764-989c-3f272ac40574 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075878 Jan 28 01:18:38.252203 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1282 bytes} [Fri Jan 28 01:18:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:18:38.263915 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-d040e6b9-ecf4-42fc-8536-c19320cd1e7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:18:38.292582 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-d040e6b9-ecf4-42fc-8536-c19320cd1e7d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032245 Jan 28 01:18:38.293174 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1332 bytes} [Fri Jan 28 01:18:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:18:59.354329 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-6a031859-11fa-4764-989c-3f272ac40574 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:59.355956 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-6a031859-11fa-4764-989c-3f272ac40574 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002372 Jan 28 01:18:59.356595 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:18:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:18:59.426930 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-07cf0bcf-791e-4e4f-b703-b45b7b828632 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:18:59.444242 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-07cf0bcf-791e-4e4f-b703-b45b7b828632 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.078003 Jan 28 01:18:59.444771 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jan 28 01:18:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:00.833913 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-6a031859-11fa-4764-989c-3f272ac40574 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:00.834912 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-6a031859-11fa-4764-989c-3f272ac40574 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jan 28 01:19:00.835311 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:01.034002 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-d5da72f1-0942-40f6-a49f-024385fa7d4a admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:01.040044 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.wsgi [None req-d5da72f1-0942-40f6-a49f-024385fa7d4a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:19:01.040610 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-d5da72f1-0942-40f6-a49f-024385fa7d4a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:19:01.041437 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-d5da72f1-0942-40f6-a49f-024385fa7d4a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065274 Jan 28 01:19:01.041950 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jan 28 01:19:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:01.051526 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-0be95b8a-eb01-4dc6-a029-4271d67529d1 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:01.072428 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-0be95b8a-eb01-4dc6-a029-4271d67529d1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024617 Jan 28 01:19:01.072938 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jan 28 01:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:01.082567 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-83bfdb6f-5052-41d9-b7dc-46d308faebf5 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:01.103880 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-83bfdb6f-5052-41d9-b7dc-46d308faebf5 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024763 Jan 28 01:19:01.104436 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jan 28 01:19:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:01.113746 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-b4c91af4-c647-4e38-8b67-aa0552b06b4e admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:01.119692 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.wsgi [None req-b4c91af4-c647-4e38-8b67-aa0552b06b4e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 28 01:19:01.120241 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-b4c91af4-c647-4e38-8b67-aa0552b06b4e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:19:01.121024 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-b4c91af4-c647-4e38-8b67-aa0552b06b4e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010805 Jan 28 01:19:01.121563 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jan 28 01:19:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:02.385911 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-83bfdb6f-5052-41d9-b7dc-46d308faebf5 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:02.386913 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-83bfdb6f-5052-41d9-b7dc-46d308faebf5 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jan 28 01:19:02.387333 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:02.578535 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-03163f79-e074-4c03-bfa2-b6c73451bf16 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:02.584273 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.wsgi [None req-03163f79-e074-4c03-bfa2-b6c73451bf16 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:19:02.584815 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-03163f79-e074-4c03-bfa2-b6c73451bf16 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:19:02.585623 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-03163f79-e074-4c03-bfa2-b6c73451bf16 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059499 Jan 28 01:19:02.586126 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jan 28 01:19:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:02.596103 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-b2c1d457-51cf-4136-adef-14cdaa5ab2a3 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:02.610307 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-b2c1d457-51cf-4136-adef-14cdaa5ab2a3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017820 Jan 28 01:19:02.610812 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jan 28 01:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:02.620307 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-ccb9c4bc-7409-4ed2-b2a2-131b0ac3ef92 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:02.634075 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-ccb9c4bc-7409-4ed2-b2a2-131b0ac3ef92 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017253 Jan 28 01:19:02.634606 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jan 28 01:19:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:02.643958 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-716982c1-730b-4dbd-b9bf-66cb13dd09b4 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:02.649708 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.wsgi [None req-716982c1-730b-4dbd-b9bf-66cb13dd09b4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 28 01:19:02.650273 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-716982c1-730b-4dbd-b9bf-66cb13dd09b4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:19:02.651053 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-716982c1-730b-4dbd-b9bf-66cb13dd09b4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010758 Jan 28 01:19:02.651546 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Jan 28 01:19:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:03.918049 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-ccb9c4bc-7409-4ed2-b2a2-131b0ac3ef92 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:03.919072 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-ccb9c4bc-7409-4ed2-b2a2-131b0ac3ef92 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jan 28 01:19:03.919459 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:04.117677 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-37fa1b4f-efd5-4575-a5c5-09843dd4a11e admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:04.123031 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.wsgi [None req-37fa1b4f-efd5-4575-a5c5-09843dd4a11e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:19:04.123574 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-37fa1b4f-efd5-4575-a5c5-09843dd4a11e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101713) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:19:04.124356 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-37fa1b4f-efd5-4575-a5c5-09843dd4a11e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066347 Jan 28 01:19:04.124856 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jan 28 01:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:04.136912 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-6df386fb-cff1-40a2-bd76-c1d98c6da3a4 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:04.156295 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-6df386fb-cff1-40a2-bd76-c1d98c6da3a4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024848 Jan 28 01:19:04.157008 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jan 28 01:19:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:04.167257 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:04.180837 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017411 Jan 28 01:19:04.181377 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Jan 28 01:19:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:04.190796 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-61eb08e6-4723-4c79-9ebb-47a8d2babab2 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:04.196447 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.wsgi [None req-61eb08e6-4723-4c79-9ebb-47a8d2babab2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 28 01:19:04.196994 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-61eb08e6-4723-4c79-9ebb-47a8d2babab2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:19:04.197806 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-61eb08e6-4723-4c79-9ebb-47a8d2babab2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010607 Jan 28 01:19:04.198295 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jan 28 01:19:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 28 01:19:05.461838 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:05.462846 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jan 28 01:19:05.463245 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:05.655790 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-651381b6-0cac-40fc-9891-399a60ac86dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:19:05.676603 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-651381b6-0cac-40fc-9891-399a60ac86dd admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075196 Jan 28 01:19:05.677105 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jan 28 01:19:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:19:06.949658 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:06.950658 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jan 28 01:19:06.951042 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:07.148052 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-68d56c3f-0cd5-42ba-ba70-527041b10957 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:19:07.170585 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-68d56c3f-0cd5-42ba-ba70-527041b10957 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.081253 Jan 28 01:19:07.171122 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jan 28 01:19:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:19:08.441178 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:08.442212 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 28 01:19:08.442705 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:08.661136 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-3a48f351-70d5-49b3-9fad-08f012c9a3f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:19:08.681840 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-3a48f351-70d5-49b3-9fad-08f012c9a3f8 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088824 Jan 28 01:19:08.682386 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jan 28 01:19:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:19:09.940455 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:09.941552 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jan 28 01:19:09.941917 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:10.145500 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-ed2f769b-4d19-4df2-a5bd-46022ad9274b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:19:10.165877 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-ed2f769b-4d19-4df2-a5bd-46022ad9274b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.086659 Jan 28 01:19:10.166414 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Jan 28 01:19:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:19:11.427975 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:11.428985 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Jan 28 01:19:11.429408 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:11.640011 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-a005b86f-8714-4dec-bc23-28e36261c816 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:11.659302 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-a005b86f-8714-4dec-bc23-28e36261c816 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.089765 Jan 28 01:19:11.659837 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Jan 28 01:19:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:57.064171 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:57.065196 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-838cb58d-c70b-4f44-a3f6-cc202dd32f75 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 28 01:19:57.065619 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 930 bytes} [Fri Jan 28 01:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:19:57.124840 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-000d4039-14c1-4157-846c-889019b56b86 admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:57.144929 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-000d4039-14c1-4157-846c-889019b56b86 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072940 Jan 28 01:19:57.145516 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1291 bytes} [Fri Jan 28 01:19:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:19:57.168186 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-5210ae17-7467-45f6-8466-f72c546daf6c admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:57.176896 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-5210ae17-7467-45f6-8466-f72c546daf6c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012417 Jan 28 01:19:57.177452 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1282 bytes} [Fri Jan 28 01:19:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:19:57.189766 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-7c412fa3-77f3-4724-bf4a-d78318a8553b admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:57.198115 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-7c412fa3-77f3-4724-bf4a-d78318a8553b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012136 Jan 28 01:19:57.198645 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Jan 28 01:19:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:19:57.213691 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-5331d292-3817-460c-9a29-d5fe90c5bda7 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:57.225558 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-5331d292-3817-460c-9a29-d5fe90c5bda7 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018192 Jan 28 01:19:57.226051 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1285 bytes} [Fri Jan 28 01:19:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:19:57.237415 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:19:57.245771 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011967 Jan 28 01:19:57.246293 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1282 bytes} [Fri Jan 28 01:19:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:21:24.664838 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-6335025d-3692-4080-a9d9-374c49569ea5 tempest-verify_tempest_config-1268404756 tempest-verify_tempest_config-1268404756-project] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:21:24.666858 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-6335025d-3692-4080-a9d9-374c49569ea5 tempest-verify_tempest_config-1268404756 tempest-verify_tempest_config-1268404756-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.122515 Jan 28 01:21:24.667386 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jan 28 01:21:24 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:23:01.563911 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:01.565031 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Jan 28 01:23:01.565484 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:23:01.883880 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-ffe04147-21ea-432a-834e-bf1b927c850a admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:01.885899 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:23:01.885899 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: warnings.warn(msg) Jan 28 01:23:01.888629 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-ffe04147-21ea-432a-834e-bf1b927c850a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:01.889514 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-ffe04147-21ea-432a-834e-bf1b927c850a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:01.890734 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-ffe04147-21ea-432a-834e-bf1b927c850a admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:01.891435 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-ffe04147-21ea-432a-834e-bf1b927c850a admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:01.947110 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-ffe04147-21ea-432a-834e-bf1b927c850a admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.229284 Jan 28 01:23:01.948007 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 35/71] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jan 28 01:23:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:23:03.308367 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:03.309416 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jan 28 01:23:03.309814 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:23:03.514377 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-954dc4cc-b62a-4742-942a-6d5ca0ae19fb admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:03.516469 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:23:03.516469 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: warnings.warn(msg) Jan 28 01:23:03.518849 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-954dc4cc-b62a-4742-942a-6d5ca0ae19fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:03.519283 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-954dc4cc-b62a-4742-942a-6d5ca0ae19fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:03.520264 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-954dc4cc-b62a-4742-942a-6d5ca0ae19fb admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:03.520981 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-954dc4cc-b62a-4742-942a-6d5ca0ae19fb admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:03.549904 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-954dc4cc-b62a-4742-942a-6d5ca0ae19fb admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.098212 Jan 28 01:23:03.550493 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 36/73] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jan 28 01:23:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:23:15.286654 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:15.287628 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jan 28 01:23:15.288047 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 38/74] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:23:15.495851 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-39e3dc1e-6faa-4a0d-b09c-ff95593814be admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:15.497512 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:23:15.497512 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: warnings.warn(msg) Jan 28 01:23:15.499881 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-39e3dc1e-6faa-4a0d-b09c-ff95593814be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:15.500528 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-39e3dc1e-6faa-4a0d-b09c-ff95593814be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:15.501588 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-39e3dc1e-6faa-4a0d-b09c-ff95593814be admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:15.502178 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-39e3dc1e-6faa-4a0d-b09c-ff95593814be admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:15.530425 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-39e3dc1e-6faa-4a0d-b09c-ff95593814be admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.101959 Jan 28 01:23:15.531016 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 37/75] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jan 28 01:23:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:23:16.803729 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: DEBUG nova.api.openstack.wsgi [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] Calling method '>' {{(pid=101712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:16.804738 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: INFO nova.api.openstack.requestlog [None req-0056d11b-381a-484e-a0b7-af0fad6376fe admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 28 01:23:16.805110 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: [pid: 101712|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Jan 28 01:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:23:17.011858 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG nova.api.openstack.wsgi [None req-1f7985d0-f2c9-4c84-88a3-7b9fe92d5138 admin admin] Calling method '>' {{(pid=101713) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:23:17.012968 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:23:17.012968 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: warnings.warn(msg) Jan 28 01:23:17.014604 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-1f7985d0-f2c9-4c84-88a3-7b9fe92d5138 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:17.015041 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-1f7985d0-f2c9-4c84-88a3-7b9fe92d5138 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:17.015829 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-1f7985d0-f2c9-4c84-88a3-7b9fe92d5138 admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:23:17.016251 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: DEBUG oslo_concurrency.lockutils [None req-1f7985d0-f2c9-4c84-88a3-7b9fe92d5138 admin admin] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101713) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:23:17.037134 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: INFO nova.api.openstack.requestlog [None req-1f7985d0-f2c9-4c84-88a3-7b9fe92d5138 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092165 Jan 28 01:23:17.037698 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: [pid: 101713|app: 0|req: 38/77] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Jan 28 01:23:16 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:24:17.678737 dv-cinder-826623-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 28 01:24:17.679679 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: Fri Jan 28 01:24:17 2022 - graceful shutdown triggered... Jan 28 01:24:17.680188 dv-cinder-826623-2-iscsi devstack@n-api.service[101712]: Gracefully killing worker 1 (pid: 101712)... Jan 28 01:24:17.680577 dv-cinder-826623-2-iscsi devstack@n-api.service[101713]: Gracefully killing worker 2 (pid: 101713)... Jan 28 01:24:18.680893 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: worker 1 buried after 1 seconds Jan 28 01:24:18.680893 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: worker 2 buried after 1 seconds Jan 28 01:24:18.680893 dv-cinder-826623-2-iscsi devstack@n-api.service[101711]: goodbye to uWSGI. Jan 28 01:24:18.682791 dv-cinder-826623-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 28 01:24:18.683447 dv-cinder-826623-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 28 01:24:18.686658 dv-cinder-826623-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 28 01:24:18.698651 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 28 01:24:18 2022] *** Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: nodename: dv-cinder-826623-2-iscsi Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: machine: x86_64 Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: clock source: unix Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: pcre jit disabled Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: detected number of CPU cores: 4 Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: current working directory: / Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: detected binary path: /usr/bin/uwsgi-core Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: your processes number limit is 47680 Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: your memory page size is 4096 bytes Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: detected max file descriptor number: 2048 Jan 28 01:24:18.701373 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: lock engine: pthread robust mutexes Jan 28 01:24:18.702445 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: thunder lock: enabled Jan 28 01:24:18.702445 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 28 01:24:18.702445 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 28 01:24:18.749330 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: Python main interpreter initialized at 0x56369b6f19c0 Jan 28 01:24:18.749330 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: python threads support enabled Jan 28 01:24:18.749330 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: your server socket listen backlog is limited to 100 connections Jan 28 01:24:18.749330 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: your mercy for graceful operations on workers is 90 seconds Jan 28 01:24:18.750000 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: mapped 403077 bytes (393 KB) for 2 cores Jan 28 01:24:18.750000 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: *** Operational MODE: preforking *** Jan 28 01:24:18.750000 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: *** uWSGI is running in multiple interpreter mode *** Jan 28 01:24:18.750000 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: spawned uWSGI master process (pid: 116146) Jan 28 01:24:18.750202 dv-cinder-826623-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 28 01:24:18.752429 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: spawned uWSGI worker 1 (pid: 116162, cores: 1) Jan 28 01:24:18.752429 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: spawned uWSGI worker 2 (pid: 116163, cores: 1) Jan 28 01:24:18.761352 dv-cinder-826623-2-iscsi devstack@n-api.service[116146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 28 01:24:20.669090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:24:20.669090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: from cryptography.utils import int_from_bytes Jan 28 01:24:20.669818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:24:20.669818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: from cryptography.utils import int_from_bytes Jan 28 01:24:20.669818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:24:20.669818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: from cryptography.utils import int_from_bytes Jan 28 01:24:20.670447 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 28 01:24:20.670447 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: from cryptography.utils import int_from_bytes Jan 28 01:24:23.080915 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:24:23.081662 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:24:23.081662 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:24:23.082029 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:24:23.082248 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:24:23.082662 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.082987 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.083307 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.083622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.083946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.084254 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.084573 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.084882 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.085661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.085924 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.086236 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.086566 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826623-2-iscsi {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.086891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.087202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.087518 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.087834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.088140 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.088457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.088767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.089269 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.090656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.090656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.090656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.090656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.091296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.091296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.091652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.091868 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.092177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.092490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.092870 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826623-2-iscsi {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.093298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.093552 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.093812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.094239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.094550 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.094854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.095174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.095497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.095803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.096132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.096441 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.096756 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.097074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.097400 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.097705 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.098038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.098324 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.098634 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.098935 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.099182 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.099494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.099812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.100114 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.100434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.100683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.100932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.101265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.101587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.101895 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.102200 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.102506 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.102810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.103116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.103418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.104142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.104142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.104435 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.104619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.104936 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.105267 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.105589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.105984 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.106233 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.106540 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.106878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.107794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.107794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.108071 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.108219 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.108521 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.108833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.109140 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.109484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.109828 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.110125 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.110373 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.110674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.110977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.111293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.111599 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.111905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.112209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.112510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.112815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.113120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.113450 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.113756 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.114063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.114361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.114667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.114972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.115275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.115591 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.115986 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.116215 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.116520 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.116824 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.117128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.117525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.117773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.118077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.118398 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.118710 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.119012 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.119328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.119633 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.119937 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.120252 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.120552 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.120856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.121170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.121503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.121808 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.122110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.122412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.122744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.123049 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.123353 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.123656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.123954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.124276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.124589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.124897 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.125202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.125529 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.125844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.126181 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.126504 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.126840 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.127153 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.127480 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.127809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.128123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.128432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.128750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.129071 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.129407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.129719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.130030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.130344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.130658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.130979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.131291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.131603 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.131918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.132227 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.132539 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.132861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.133177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.133511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.133850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.134188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.134498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.134820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.135130 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.135450 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.135762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.136073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.136383 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.136710 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.137022 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.137358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.137696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.138013 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.138418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.138732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.139037 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.139343 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.139652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.139954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.140272 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.140595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.140902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.141277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.141560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.141870 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.142180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.142492 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.142796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.143106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.143415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.143718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.144036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.144343 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.144644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.144965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.145856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.145856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.146140 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.146284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.146488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.146785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.147105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.147414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.147724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.148352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.148352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.148727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.149051 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.150023 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.150023 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.150023 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.150424 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 28 01:24:23.150892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.151025 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 28 01:24:23.151148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.151148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.151359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 28 01:24:23.151469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.151586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 28 01:24:23.151703 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.151820 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 28 01:24:23.151930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.152036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.152155 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.152265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.152372 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.152479 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.152594 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.152779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.152914 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.153148 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.153303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.153444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.153528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.153880 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.154004 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.154092 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.154235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.154395 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.154504 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.154666 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.154781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.154987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.155099 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.155309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826623-2-iscsi {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.155412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.155633 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.155743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.155938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.156028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.156251 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.156347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.156579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.156689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.156885 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.156984 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.157192 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.157325 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.157527 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.157619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.157835 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.158080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.158211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.158340 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.158440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.158650 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.158740 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.158967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.159070 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.159309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.159408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.159629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.159720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.159939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.160027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.160255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.160355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.160555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.160654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.160871 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.160971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.161180 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.161291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.161546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.161651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826623-2-iscsi {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.161859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.161964 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.162176 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.162267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.162486 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.162583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.162800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.162901 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.163108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.163199 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.163416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.163505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.163723 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.163822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.164028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.164139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.164340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.164510 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.164646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.164737 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.164960 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.165063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.165286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.165412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.165606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.165707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.165912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.166003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.166228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.166325 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.166528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.166633 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.166840 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.166943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.167166 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.167256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.167475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.167565 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.167729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.167819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.168039 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.168142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.168365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.168467 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.168686 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.168785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.169010 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.169118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.169283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.169403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.169700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.169794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.170029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.170134 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.170344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.170433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.170656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.170755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.170966 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.171063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.171274 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.171378 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.171579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.171676 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.171886 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.171975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.172191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.172289 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.172495 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.172592 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.172799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.172891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.173108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.173204 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.173449 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.173564 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.173760 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.173851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.174168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.174280 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.174391 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.174489 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.174695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.174787 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.175001 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.175101 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.175370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.175489 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.175625 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.175715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.175927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.176024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.176567 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.176698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.176794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.176895 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.176972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.177061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.177339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.177465 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.177558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.177642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.177770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.177870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.178091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.178191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.178411 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.178516 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.178717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.178808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.178971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.179069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.179276 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.179367 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.179585 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.179684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.179905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.179999 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.180214 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.180328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.180991 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.181112 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.181112 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.181302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.181401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.181499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.181601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.181693 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.181784 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.181866 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.182026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.182116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.182334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.182433 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.182643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.182734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.182944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.183042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.183252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.183361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.183561 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.183650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.183868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.184137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.184257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.184471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.184581 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.184781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.184872 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.185138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.185305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.185506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.185619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.185785 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.185886 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.186147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.186246 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.186460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.186559 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.186776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.186878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.187077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.187162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.187456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.187568 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.187689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.187789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.187992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.188094 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.188300 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.188399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.188603 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.188706 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.188907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.188998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.189206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.189341 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.189537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.189642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.189837 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.189934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.190150 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.190248 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.190449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.190538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.190749 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.190849 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.191055 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.191145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.191352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.191440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.191658 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.191755 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.191955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.192045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.192261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.192358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.192565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.192664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.192861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.192949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.193161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.193284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.193494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.193586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.193814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.193909 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.194118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.194213 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.194437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 28 01:24:23.194561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.194768 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.194876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.195097 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.195196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.195421 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.195512 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.195726 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.195830 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196144 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.196944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197272 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197368 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197690 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.197985 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.198191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.198290 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.198499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.198612 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.198815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.198929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.199120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.199220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.199423 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.199522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.199731 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.199824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200132 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200441 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200648 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.200973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.201072 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.201296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.201403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.201605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.201704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.201910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202307 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202613 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.202928 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.203130 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.203258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.203427 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.203578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.203725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.203906 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.204024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.204223 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.204314 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.204546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.204645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.204925 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.205951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.206131 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.206221 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.206436 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.206525 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.206736 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.206841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207136 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.207971 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.208061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.208270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.208360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.208576 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.208675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.208889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.209003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.209174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.209319 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.209502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.209596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.210481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.210595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.210689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.210781 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.210879 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.210966 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211307 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.211924 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212630 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212831 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.212922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.213128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.213249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.213491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.213615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.213794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.213929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.214146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.214322 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.214451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.214559 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.214763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.214866 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.215080 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.215193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.215389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.215490 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.215695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.215786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216006 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216122 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216671 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216762 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.216979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.217079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.217318 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.217412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.217819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.217929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218128 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218212 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218332 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218517 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.218947 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.219154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.219264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.219471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.219578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.219790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.219881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.220090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.220180 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.220401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.220504 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.220711 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.220800 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221107 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221349 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.221965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222375 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.222974 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.223190 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.223290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.223491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.223580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.223800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.223898 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.224108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.224208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.224408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.224497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.224730 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.224842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225372 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225474 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225770 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.225982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.226095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.226296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.226399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.226597 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.226699 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.226943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.227033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.227267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.227364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.227582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.227685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.227926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228519 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228624 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.228924 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.229215 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.229351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.229480 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.229585 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.229798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.229896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.230139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.230230 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.230475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.230626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.230784 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.230875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.231107 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.231204 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.231408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.231499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.231727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.231816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.232473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.232584 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.232584 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.232757 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.232841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.232922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233012 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233264 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233373 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.233992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.234207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.234305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.234532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.234631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.234842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.234939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.235162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.235294 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.235476 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.235587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.235780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.235902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.236112 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.236210 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.236449 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.236561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.236767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.236871 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.237084 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.237176 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.237434 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.237524 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.237750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.237857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238066 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238688 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238780 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.238995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.239092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.239321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.239424 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.239627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.239727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.239944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240035 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240346 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240564 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240883 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.240979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.241197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.241371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.241532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.241642 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.241842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.241933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.242158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.242257 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.242484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.242598 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243285 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243542 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243625 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243706 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243787 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.243976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244077 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244377 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244686 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244897 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.244992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.245206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.245357 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.245586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.245692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.245849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.245941 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.246170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.246284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.246541 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.246647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.246789 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.246889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.247094 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.247202 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.247414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.247505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.247781 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.247875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.248154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.248265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.248400 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.248500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.248726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.248830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249430 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249648 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249732 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.249974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.250073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.250279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.250381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.250592 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.250690 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.250916 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251229 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251332 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251849 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.251939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.252155 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.252258 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.252466 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.252555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.252780 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.252869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.253104 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.253371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.253476 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.253709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.253807 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254021 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254124 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254417 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.254929 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255030 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255346 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.255948 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.256133 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.256231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.256453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.256626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.256830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.256944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257391 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257503 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257787 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.257999 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.258090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.258299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.258402 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.258609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.258708 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.258915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259549 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259854 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.259963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.260170 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.260262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.260477 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.260568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.260793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.260898 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.261099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.261198 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.261437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.262952 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.263042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.263280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.263382 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.263596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.263695 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.263910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.264008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.264225 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.264324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.264566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265112 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265536 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265785 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.265999 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.266100 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.266310 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.266410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.266623 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.266723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.266992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267106 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267242 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267551 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.267961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.268178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.268277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.268488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.268591 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.268798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.268903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.269107 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.269197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.269447 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.269578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.269759 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.269876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.270993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.271092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.271298 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.271397 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.271605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.271704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.271905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272071 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272307 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272523 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272829 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.272920 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.273136 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.273273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.273469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.273569 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.273780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.273878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.274085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.274175 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.274393 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.274483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.274702 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.274791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275007 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275109 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275624 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.275931 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.276020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.276656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.276767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.276767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.276936 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.276936 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277487 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277788 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.277998 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.278098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.278319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.278417 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.278643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.278755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279000 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279109 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279615 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279713 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.279920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280023 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280225 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.280914 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.281146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.281282 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.281475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.281578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.281775 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.281864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.282075 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.282182 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.282384 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.282482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.282706 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.282915 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.283067 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.283266 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.283378 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.283585 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.283683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.283912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284865 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.284963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.285190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.285316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.285526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.285621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.285831 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286132 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.286845 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287047 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287448 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.287971 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.288085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.288277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.288370 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.288585 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.288691 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.288900 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289198 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289633 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.289937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.290145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.290248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.290445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.290546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.290747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.290846 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291049 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291148 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.291958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292125 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292353 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292870 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.292974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.293169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.293323 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.293502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.293601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.293804 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.293904 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.294110 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.294200 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.294432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.294538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.294746 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.294839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295060 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295370 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295460 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295784 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.295993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.296106 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.296796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.296902 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.296987 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297066 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297143 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297250 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297664 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.297983 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.298174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.298280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.298498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.298701 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.298827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299131 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299340 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299755 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.299963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.300053 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.300766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.300878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.300986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301059 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301581 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.301873 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.302115 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.302219 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.302421 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.302513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.302731 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.302821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.303041 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.303146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.303351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.303462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.303664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.303779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304531 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304894 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.304988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.305080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.305275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.305417 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.305546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.305744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.305847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.306052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.306152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.306375 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.306472 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.306690 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.306791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307016 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307104 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.307960 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.308049 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.308314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.308441 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.308591 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.308685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.308916 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309018 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309581 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309682 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.309997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.310321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.310440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.310641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.310743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.310950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.311998 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.312221 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.312313 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.312529 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.312627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.312832 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.312931 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.313135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.313247 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.313469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.313572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.313781 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.313889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.314098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.314190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.314409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.314499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.314716 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.314822 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.315022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.315113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.315337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.315426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.315641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.315743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316122 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316235 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316413 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.316969 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.317342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.317449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.317550 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.317645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.317818 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.317920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.318129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.318228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.318452 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.318558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.318730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.318829 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319694 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.319999 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.320101 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.320321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.320435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.320637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.320749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.320955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.321058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.321295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.321403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.321606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.321698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.321926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322236 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322550 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.322960 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.323167 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.323268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.323476 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.323566 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.323786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.323888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.324094 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.324186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.324407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.324498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.324715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.324806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.325024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.325115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.325358 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.325453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.325716 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.325813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326762 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.326983 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.327080 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.327300 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.327413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.327508 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116162) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:24:23.327595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.327920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.328226 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.328612 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.328875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.329199 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.329615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.329863 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.330191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.330512 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.330834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.331152 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.331472 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.331791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.332109 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.332427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.332739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.333057 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.333406 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.333729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.334284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.334615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.334934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.335599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.335915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.336237 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.336553 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.336870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.337186 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.337526 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.337840 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.338174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.338502 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.338834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.339173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.339563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.339812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.340129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.340448 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.340812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.341130 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.341539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.341885 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.342215 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.342553 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.342868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.343183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.343501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.343818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.344136 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.344453 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.344771 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.345087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.345446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.346856 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.346856 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.346856 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.346856 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.347398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.347607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.347852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.348190 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.348522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.348863 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.349189 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.349546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.349908 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.350166 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.350487 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.350791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.351044 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_db.sqlalchemy.engines [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.351200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.351399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.351727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.352042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.352350 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.352675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.352987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.353560 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.353918 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.354239 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.354571 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.354902 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.355224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.355535 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.355865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.356183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.356495 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.356813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.357181 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.357513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.357824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.358139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.358453 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.358763 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.359076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.359383 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.359714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.360026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.360331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.360640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.361026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.361285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.361596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.361904 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.362210 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.362524 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.362830 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.363141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.363445 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.363759 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.364064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.364377 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.364682 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.365012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.365345 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.365654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.365975 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.366337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.366621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.366932 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.367303 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.367592 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.367912 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.368495 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.368829 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.369209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.369507 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.369840 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.370152 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.370458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.370765 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.371129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.371401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.371718 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.372033 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.372349 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.372735 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.373044 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.373385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.373702 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.374018 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.374331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.374645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.374962 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.375305 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.375628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.375950 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.376276 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.376623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.376907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.377219 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.377558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.377901 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.378186 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.378516 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.378833 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.379142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.379573 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.379886 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.380211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.380535 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.380850 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.381281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.381526 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.381839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.382166 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.382480 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.382813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.383157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.383488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.383813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.384122 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.384429 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.384736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.385052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.385421 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.385757 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.386079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.386409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.386729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.387042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.387358 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.387683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.388003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.388343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.388656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.388992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.389335 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.389651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.389964 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.390280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.390591 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.390903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.391234 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.391565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.391872 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.392197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.392521 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.392839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.393160 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.393499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.393835 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.394152 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.394470 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.394784 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.395099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.395415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.395734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.396064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.396399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.396726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.397067 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.397434 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.397753 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.398108 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.398426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.398746 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.399063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.399370 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 28 01:24:23.399623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 28 01:24:23.411922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.context [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),839f0624-fa55-455e-8eb6-3b061d667ee0(cell1) {{(pid=116162) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:24:23.416280 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:24:23.418045 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:24:23.418764 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:24:23.420721 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:24:23.422708 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_db.sqlalchemy.engines [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.431284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_db.sqlalchemy.engines [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.432689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_db.sqlalchemy.engines [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.492774 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.context [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),839f0624-fa55-455e-8eb6-3b061d667ee0(cell1) {{(pid=116163) load_cells /opt/stack/nova/nova/context.py:464}} Jan 28 01:24:23.500152 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:24:23.503078 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:24:23.504450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:24:23.507681 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:24:23.524129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_db.sqlalchemy.engines [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.525584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_db.sqlalchemy.engines [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.594593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_db.sqlalchemy.engines [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116162) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.699364 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_db.sqlalchemy.engines [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 28 01:24:23.916198 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: WARNING keystonemiddleware.auth_token [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:24:23.923132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: WARNING keystonemiddleware.auth_token [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:24:24.022267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: WARNING keystonemiddleware.auth_token [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:24:24.029544 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: WARNING keystonemiddleware.auth_token [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:24:24.260759 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: WARNING keystonemiddleware.auth_token [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:24:24.266135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: WARNING keystonemiddleware.auth_token [None req-d2cea441-c6dd-49e9-9d6c-3b0f3d2a61b5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:24:24.271839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56369b6f19c0 pid: 116162 (default app) Jan 28 01:24:24.369763 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: WARNING keystonemiddleware.auth_token [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 28 01:24:24.374935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: WARNING keystonemiddleware.auth_token [None req-c0768916-f7e2-43b3-bea6-265885d696e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 28 01:24:24.380269 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56369b6f19c0 pid: 116163 (default app) Jan 28 01:24:59.211191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-659f9327-b7d1-4cbb-adef-9d0bf39c1a4c tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Action: 'create', calling method: .version_select at 0x7f7e7cd93ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-754790441"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:24:59.256834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-35cbe4af-f0b5-45a0-96c8-68d1bedb6fe7 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Action: 'create', calling method: .version_select at 0x7f7e7cd92ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1990686912", "metadata": {"Type": "work"}}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:00.634759 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-659f9327-b7d1-4cbb-adef-9d0bf39c1a4c tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.747790 Jan 28 01:25:00.639905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1154 bytes} [Fri Jan 28 01:24:57 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2755 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 28 01:25:00.879444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-70942ee7-a746-4b91-8ae2-7a769296c17e tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Action: 'create', calling method: .version_select at 0x7f7e7cd0c820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1159027781", "metadata": {"Type": "work"}}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:00.881730 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-70942ee7-a746-4b91-8ae2-7a769296c17e tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:00.885530 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-70942ee7-a746-4b91-8ae2-7a769296c17e tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.243681 Jan 28 01:25:00.899655 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 2/2] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jan 28 01:25:00 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 259 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:25:01.111797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2066994191", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "b39f7a55-675b-4821-a61a-a2d88e3cacd5"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:01.371580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] validate_networks() for [('b39f7a55-675b-4821-a61a-a2d88e3cacd5', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:25:01.663828 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-35cbe4af-f0b5-45a0-96c8-68d1bedb6fe7 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.743009 Jan 28 01:25:01.664811 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jan 28 01:24:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3746 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jan 28 01:25:01.740077 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1212418757", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "f525b51a-eb62-40da-a322-ce44c34a7fb0"}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:01.858406 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] validate_networks() for [('f525b51a-eb62-40da-a322-ce44c34a7fb0', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:25:03.149504 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:25:03.151715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:25:03.152662 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:25:03.153396 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:25:03.154555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:25:03.172470 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:25:03.174041 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:25:03.174971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:25:03.175535 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:25:03.177608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:25:03.190211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:03.191592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:03.196440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:03.197138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:03.201298 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:03.202014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:03.205001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:03.205691 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:03.273057 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Getting quotas for project 5e75918ca77e4370a5219466a06ca9a6. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:03.274784 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:03.282774 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Getting quotas for user 0ee6fde063b34646b4ca6d477f389002 and project 5e75918ca77e4370a5219466a06ca9a6. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:03.286136 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for user bdd86efb97ad48a994f04304a8459e54 and project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:03.307369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:25:03.310419 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:25:03.320470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:25:03.325221 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:25:03.462678 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-24361d3d-a024-4db6-bf1b-3d1e884f6c83 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795615 Jan 28 01:25:03.463325 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:25:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:25:03.469864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4846bf84-81d4-4c99-bfc9-13ba40b50ea9 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c303040>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:03.470510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6d5cf399-0f59-4239-981d-4e37ba6202df tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.568655 Jan 28 01:25:03.471732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 3/5] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:25:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:25:03.480875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ba7b1ad8-012c-41b0-bf5d-d5900bc6ff41 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Action: 'create', calling method: .version_select at 0x7f7e7c3071f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-363564511", "metadata": {"Type": "work"}}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:03.483116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ba7b1ad8-012c-41b0-bf5d-d5900bc6ff41 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:03.488290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ba7b1ad8-012c-41b0-bf5d-d5900bc6ff41 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012190 Jan 28 01:25:03.490698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 4/6] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jan 28 01:25:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:25:03.506052 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7a7c4624-fff8-468b-bac1-ea80c6b135e8 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Calling method '.version_select at 0x7f7e7c307a60>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:03.547281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4846bf84-81d4-4c99-bfc9-13ba40b50ea9 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d" status: 200 len: 345 microversion: 2.1 time: 0.082494 Jan 28 01:25:03.548330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:03 2022] GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:03.553329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-30f03fc7-a235-42ba-9930-72f379c2ad7c tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:03.554638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-30f03fc7-a235-42ba-9930-72f379c2ad7c tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:03.675197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7a7c4624-fff8-468b-bac1-ea80c6b135e8 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4" status: 200 len: 354 microversion: 2.1 time: 0.182881 Jan 28 01:25:03.676011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:03 2022] GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4 => generated 354 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:03.680867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-746a49a9-cb66-40f4-bc21-c8193357dcb0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:03.681843 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-746a49a9-cb66-40f4-bc21-c8193357dcb0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:04.525864 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-746a49a9-cb66-40f4-bc21-c8193357dcb0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:04.565752 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-746a49a9-cb66-40f4-bc21-c8193357dcb0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1218 microversion: 2.1 time: 0.888569 Jan 28 01:25:04.596505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 6/9] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:03 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1218 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:04.616801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2fe14e9f-638e-4a7b-84b7-8a35a88fa24f tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Action: 'create', calling method: .version_select at 0x7f7e7c307280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-249690780", "metadata": {"Type": "work"}}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:04.621581 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2fe14e9f-638e-4a7b-84b7-8a35a88fa24f tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:04.622876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2fe14e9f-638e-4a7b-84b7-8a35a88fa24f tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018464 Jan 28 01:25:04.624128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 7/10] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Jan 28 01:25:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:25:04.632602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-75698ec2-49a7-41f6-88e0-d177bf97ca25 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Action: 'create', calling method: .version_select at 0x7f7e7c2aeca0>, body: {"snapshot": {"volume_id": "0f801089-0ef4-4ea1-be7a-9ebd1bb4913d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1967268495"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:04.712198 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-30f03fc7-a235-42ba-9930-72f379c2ad7c tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:04.749700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-30f03fc7-a235-42ba-9930-72f379c2ad7c tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1215 microversion: 2.1 time: 1.200013 Jan 28 01:25:04.756114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 4/11] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:03 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1215 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:04.782847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-02ca510d-ab1e-41aa-9dea-094527b46ddc tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Calling method '.version_select at 0x7f7e7c303040>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:04.949208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-02ca510d-ab1e-41aa-9dea-094527b46ddc tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4" status: 200 len: 354 microversion: 2.1 time: 0.179363 Jan 28 01:25:04.950169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:04 2022] GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:04.963594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-37160790-e2a5-4e51-837a-6ac47ab12fd3 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Calling method '.version_select at 0x7f7e7c2a9ca0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.040213 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-37160790-e2a5-4e51-837a-6ac47ab12fd3 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] HTTP exception thrown: Volume tempest-invalid-665268948 could not be found. Jan 28 01:25:05.042191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-37160790-e2a5-4e51-837a-6ac47ab12fd3 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Returning 404 to user: Volume tempest-invalid-665268948 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:05.044687 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-37160790-e2a5-4e51-837a-6ac47ab12fd3 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-665268948" status: 404 len: 98 microversion: 2.1 time: 0.093187 Jan 28 01:25:05.048232 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1214 bytes} [Fri Jan 28 01:25:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-665268948 => generated 98 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 28 01:25:05.059369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4fdff8ad-85cd-474a-b305-fb466d3033bc tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Calling method '.version_select at 0x7f7e7c30e8b0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.230456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4fdff8ad-85cd-474a-b305-fb466d3033bc tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4" status: 202 len: 0 microversion: 2.1 time: 0.180208 Jan 28 01:25:05.231455 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 7/14] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jan 28 01:25:05 2022] DELETE /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:25:05.238125 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-14782c06-b4a3-4807-967a-df06f3e3d7f1 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005230 Jan 28 01:25:05.239654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Jan 28 01:25:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 01:25:05.265977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ff578715-d611-42bd-8a3d-843576f7f46a tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Calling method '.version_select at 0x7f7e7c3033a0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.449608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ff578715-d611-42bd-8a3d-843576f7f46a tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4" status: 200 len: 353 microversion: 2.1 time: 0.208485 Jan 28 01:25:05.455567 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:05 2022] GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4 => generated 353 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:05.462609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-27835920-5bd1-435b-87c0-9506a48ed73a tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009941 Jan 28 01:25:05.476823 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 10/17] 10.222.0.16 () {58 vars in 1136 bytes} [Fri Jan 28 01:25:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jan 28 01:25:05.502683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5ad89633-156b-4c15-b32e-7a4819462109 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Calling method '.version_select at 0x7f7e7c303670>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.609969 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-5ad89633-156b-4c15-b32e-7a4819462109 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] HTTP exception thrown: Volume 53533f6a-f60e-4665-8d50-fc48dd826219 could not be found. Jan 28 01:25:05.610599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5ad89633-156b-4c15-b32e-7a4819462109 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Returning 404 to user: Volume 53533f6a-f60e-4665-8d50-fc48dd826219 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:05.611478 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5ad89633-156b-4c15-b32e-7a4819462109 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/53533f6a-f60e-4665-8d50-fc48dd826219" status: 404 len: 109 microversion: 2.1 time: 0.127516 Jan 28 01:25:05.627330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 11/18] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jan 28 01:25:05 2022] DELETE /compute/v2.1/os-volumes/53533f6a-f60e-4665-8d50-fc48dd826219 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:05.633930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-01d8c8cb-67f0-4350-a416-7843d4a4b71b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.636488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-01d8c8cb-67f0-4350-a416-7843d4a4b71b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:05.770954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-75698ec2-49a7-41f6-88e0-d177bf97ca25 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.145469 Jan 28 01:25:05.771537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 8/19] 10.222.0.16 () {60 vars in 1161 bytes} [Fri Jan 28 01:25:04 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:05.782253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a3a18da3-2dc6-4909-b43f-3605ac074440 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Calling method '.version_select at 0x7f7e7c2aec10>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.842456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-a3a18da3-2dc6-4909-b43f-3605ac074440 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] HTTP exception thrown: Volume 4104c092-13c7-43f7-a928-ef4fd5253fb2 could not be found. Jan 28 01:25:05.843153 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a3a18da3-2dc6-4909-b43f-3605ac074440 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] Returning 404 to user: Volume 4104c092-13c7-43f7-a928-ef4fd5253fb2 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:05.844350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a3a18da3-2dc6-4909-b43f-3605ac074440 tempest-VolumesNegativeTest-621555101 tempest-VolumesNegativeTest-621555101-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/4104c092-13c7-43f7-a928-ef4fd5253fb2" status: 404 len: 109 microversion: 2.1 time: 0.069679 Jan 28 01:25:05.844996 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 9/20] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:05 2022] GET /compute/v2.1/os-volumes/4104c092-13c7-43f7-a928-ef4fd5253fb2 => generated 109 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:05.855728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7c5305a5-0268-403b-b96e-20995742bbcf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:05.861033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7c5305a5-0268-403b-b96e-20995742bbcf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:06.070359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-01d8c8cb-67f0-4350-a416-7843d4a4b71b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:06.091181 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-01d8c8cb-67f0-4350-a416-7843d4a4b71b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1218 microversion: 2.1 time: 0.462680 Jan 28 01:25:06.092896 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 12/21] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:05 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1218 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:06.102195 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1217d0a6-5603-452d-9d2b-741fd2c2c992 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c2b25e0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:06.173525 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1217d0a6-5603-452d-9d2b-741fd2c2c992 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 200 len: 287 microversion: 2.1 time: 0.078988 Jan 28 01:25:06.174180 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 13/22] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:06 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:06.235819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7c5305a5-0268-403b-b96e-20995742bbcf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:06.243632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7c5305a5-0268-403b-b96e-20995742bbcf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1215 microversion: 2.1 time: 0.397483 Jan 28 01:25:06.244327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 10/23] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:05 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1215 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:06.267014 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4e90a041-1d29-4292-8265-75b68e04d6b3 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c2ae040>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:06.411262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4e90a041-1d29-4292-8265-75b68e04d6b3 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.159980 Jan 28 01:25:06.411951 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 11/24] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Jan 28 01:25:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:06.424715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bc0431ad-eba8-45f1-96cb-130ea7248908 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c2b9ca0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:06.477046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bc0431ad-eba8-45f1-96cb-130ea7248908 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 200 len: 287 microversion: 2.1 time: 0.057875 Jan 28 01:25:06.478142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:06 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:06.484613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c942e5ff-80b1-4a04-b7e3-4e7e8037d5a7 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Calling method '.version_select at 0x7f7e7c2b55e0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:06.498142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-05a8702f-f40b-4e99-a5a1-a27183dd35cf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'create', calling method: .version_select at 0x7f7e7c2b2dc0>, body: {"keypair": {"name": "tempest-keypair-890896405"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:06.542520 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-05a8702f-f40b-4e99-a5a1-a27183dd35cf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:06.550583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-05a8702f-f40b-4e99-a5a1-a27183dd35cf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for user 3cd1ffeab8d74519a9b0d2d202e1cf6e and project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:06.569791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-c942e5ff-80b1-4a04-b7e3-4e7e8037d5a7 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] HTTP exception thrown: Volume 0ad15644-fa23-413f-8e70-5e2e85342cc4 could not be found. Jan 28 01:25:06.572736 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c942e5ff-80b1-4a04-b7e3-4e7e8037d5a7 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] Returning 404 to user: Volume 0ad15644-fa23-413f-8e70-5e2e85342cc4 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:06.578544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c942e5ff-80b1-4a04-b7e3-4e7e8037d5a7 tempest-VolumesGetTestJSON-1302939914 tempest-VolumesGetTestJSON-1302939914-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4" status: 404 len: 109 microversion: 2.1 time: 0.094649 Jan 28 01:25:06.584728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 13/26] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:06 2022] GET /compute/v2.1/os-volumes/0ad15644-fa23-413f-8e70-5e2e85342cc4 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:07.109709 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:07.111146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:07.134410 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:07.135265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:07.139259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:07.142281 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:07.829847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:07.856988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2ed44e78-3b26-49ad-ad20-c2c41495769d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1214 microversion: 2.1 time: 0.751333 Jan 28 01:25:07.868496 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:07 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1214 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:07.882903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:07.885093 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:07.919957 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:07.920867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:07.922728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:07.925708 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:08.002624 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-05a8702f-f40b-4e99-a5a1-a27183dd35cf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:08.017664 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-05a8702f-f40b-4e99-a5a1-a27183dd35cf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for user 3cd1ffeab8d74519a9b0d2d202e1cf6e and project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:08.030954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:08.044144 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-de8d4eaf-d1eb-4ed5-b977-ac208035a837 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1219 microversion: 2.1 time: 0.174100 Jan 28 01:25:08.045806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:07 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1219 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:08.046955 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-05a8702f-f40b-4e99-a5a1-a27183dd35cf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.871632 Jan 28 01:25:08.047576 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 14/29] 10.222.0.16 () {62 vars in 1198 bytes} [Fri Jan 28 01:25:06 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1873 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:25:08.064770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a1ecf821-4d32-409f-b54c-04ace8c218e9 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c2560d0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:08.141420 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a1ecf821-4d32-409f-b54c-04ace8c218e9 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 200 len: 287 microversion: 2.1 time: 0.093284 Jan 28 01:25:08.145416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:08 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:08.878507 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:08.879522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:08.888905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:08.898060 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:08.899793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:08.900407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:09.030659 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:09.039723 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c7609e1d-9cfb-41a5-a816-81cd011a2d1b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1214 microversion: 2.1 time: 0.164983 Jan 28 01:25:09.044006 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 17/31] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:08 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:09.064345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:09.065142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:09.119461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:09.119461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:09.119461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:09.119461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:09.123711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1376413273", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:09.220528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:09.230802 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-44b8c886-1381-45bb-a377-e349b1a0df33 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1219 microversion: 2.1 time: 0.170408 Jan 28 01:25:09.233328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 18/32] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:09 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:09.238392 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] validate_networks() for [('26e62970-b3c0-4715-8e18-a5afdae9b108', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:25:09.240382 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-182e38ec-4dc8-4742-b89b-99f1f9d2634c tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c1f2940>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:09.437528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-182e38ec-4dc8-4742-b89b-99f1f9d2634c tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 200 len: 287 microversion: 2.1 time: 0.202233 Jan 28 01:25:09.439163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 19/33] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:09 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 287 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:10.065406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:10.066427 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:10.082501 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:10.082955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:10.092167 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:10.093736 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:10.379128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:10.405929 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5bf6a158-8137-427b-9ff9-088eff013aec tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1270 microversion: 2.1 time: 0.345268 Jan 28 01:25:10.410613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 20/34] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:10 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:10.430901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:10.434025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:10.454536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:10.455293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:10.456198 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:10.459717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:10.709973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:10.723959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5300807e-e8c1-4c32-b0f8-8ac19b9fc2f4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1267 microversion: 2.1 time: 0.301450 Jan 28 01:25:10.726001 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 21/35] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:10 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1267 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:10.733442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5b8bbadb-cb1b-4fc3-8424-b400ccf86e5f tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c238dc0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:10.831399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5b8bbadb-cb1b-4fc3-8424-b400ccf86e5f tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 200 len: 288 microversion: 2.1 time: 0.103986 Jan 28 01:25:10.839473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 22/36] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:10 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 288 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:10.845284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f0da2800-41bd-46d2-8dc0-99695a3347b3 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c1eb3a0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:11.045666 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f0da2800-41bd-46d2-8dc0-99695a3347b3 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 202 len: 0 microversion: 2.1 time: 0.205095 Jan 28 01:25:11.051851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 23/37] 10.222.0.16 () {58 vars in 1253 bytes} [Fri Jan 28 01:25:10 2022] DELETE /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:25:11.061726 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-68d6f88b-0eab-4966-a52a-7c96ac111540 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c2b99d0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:11.156792 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-68d6f88b-0eab-4966-a52a-7c96ac111540 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 200 len: 287 microversion: 2.1 time: 0.099737 Jan 28 01:25:11.157734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 24/38] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:11 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:25:11.427683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:11.428426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:11.436355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:11.443967 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:11.444815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:11.445276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:11.663641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:11.672688 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-50a5a72d-c443-43af-8f0d-9173dd296ea6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1276 microversion: 2.1 time: 0.248555 Jan 28 01:25:11.681363 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 25/39] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:11 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:11.750553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:11.751423 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:11.764000 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:25:11.765087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:25:11.765766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:25:11.766359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:25:11.767161 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:25:11.770105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:11.770907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:11.774630 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:11.775420 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:11.784890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:11.785367 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:11.786171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:11.786603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:11.828874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Getting quotas for project c5a4cb240dac42849a9790a68eda072a. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:11.833169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Getting quotas for user 3bc86d41bb2d4509913630ca774b4082 and project c5a4cb240dac42849a9790a68eda072a. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:11.858929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:25:11.862628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:25:11.991429 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4bdf6354-f8cb-49c4-ba51-aad82791e2f7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.386636 Jan 28 01:25:12.003528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 15/40] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:25:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 3399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:25:12.015372 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1d967e0c-5abe-4f9e-a5f4-ec15eff2a620 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:12.015996 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1d967e0c-5abe-4f9e-a5f4-ec15eff2a620 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:12.204903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:12.212561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-92991e70-436e-4f87-9ca9-99f0dea4071d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1273 microversion: 2.1 time: 0.474158 Jan 28 01:25:12.213153 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 26/41] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:11 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1273 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:12.222670 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1d967e0c-5abe-4f9e-a5f4-ec15eff2a620 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:12.229769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1d967e0c-5abe-4f9e-a5f4-ec15eff2a620 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1222 microversion: 2.1 time: 0.224994 Jan 28 01:25:12.235076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 16/42] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:12 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:12.249753 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2f2251f5-98bf-4565-a903-c01d5c01a4de tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c1aa820>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:12.281683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-764623229", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3332b276-5138-457d-8c65-3cdaf545d049"}], "security_groups": [{"name": "tempest-securitygroup--624095747"}], "key_name": "tempest-keypair-890896405", "user_data": "}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:12.309587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-2f2251f5-98bf-4565-a903-c01d5c01a4de tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] HTTP exception thrown: Snapshot 09152cd2-f0ae-4e66-8a0a-4ab16f81c99b could not be found. Jan 28 01:25:12.310377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2f2251f5-98bf-4565-a903-c01d5c01a4de tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Returning 404 to user: Snapshot 09152cd2-f0ae-4e66-8a0a-4ab16f81c99b could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:12.311392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2f2251f5-98bf-4565-a903-c01d5c01a4de tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b" status: 404 len: 111 microversion: 2.1 time: 0.097303 Jan 28 01:25:12.312125 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 27/43] 10.222.0.16 () {58 vars in 1250 bytes} [Fri Jan 28 01:25:12 2022] GET /compute/v2.1/os-snapshots/09152cd2-f0ae-4e66-8a0a-4ab16f81c99b => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:12.320574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-109bf682-1ef6-464f-b892-f6723808fb0e tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c204d30>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:12.556732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-109bf682-1ef6-464f-b892-f6723808fb0e tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d" status: 202 len: 0 microversion: 2.1 time: 0.240174 Jan 28 01:25:12.558485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 28/44] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jan 28 01:25:12 2022] DELETE /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:25:12.569761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bcc24640-15a6-4a11-8537-678454da98e0 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c238f70>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:12.726583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bcc24640-15a6-4a11-8537-678454da98e0 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d" status: 200 len: 344 microversion: 2.1 time: 0.163805 Jan 28 01:25:12.727310 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 29/45] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:12 2022] GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:25:12.742718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:12.746926 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:12.777944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:12.780083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:12.785839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:12.787221 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:13.152173 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:13.163905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0589ef46-f76b-40e9-a28c-d1efaca40aa2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1276 microversion: 2.1 time: 0.435373 Jan 28 01:25:13.173909 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 30/46] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:12 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1276 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:13.213422 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1966544738", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:13.229081 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] validate_networks() for [('3332b276-5138-457d-8c65-3cdaf545d049', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:25:13.384361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] validate_networks() for [('26e62970-b3c0-4715-8e18-a5afdae9b108', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:25:16.454406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:25:16.454923 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:25:16.455282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:25:16.455696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:25:16.456158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:25:16.471223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:16.471631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:16.473112 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:16.473782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:16.500054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Getting quotas for project c5a4cb240dac42849a9790a68eda072a. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:16.505989 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Getting quotas for user 3bc86d41bb2d4509913630ca774b4082 and project c5a4cb240dac42849a9790a68eda072a. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:16.520754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:25:16.524033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:25:16.648443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d8299ba9-fb33-4977-974b-1baf89cb1963 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.471273 Jan 28 01:25:16.652959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 31/47] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:25:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 3478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:25:16.664800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:16.670142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:16.685511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:16.686270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:16.690579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:16.691545 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:16.879048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:25:16.879564 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:25:16.879927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:25:16.880332 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:25:16.880736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:25:16.901600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:16.902349 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:16.912972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:16.913817 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:16.979517 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for project 33608c07529f42299cd9ae077624ebdc. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:25:16.991837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for user 3cd1ffeab8d74519a9b0d2d202e1cf6e and project 33608c07529f42299cd9ae077624ebdc. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:25:17.037733 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:25:17.051162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:25:17.243927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b9336b7f-c254-41b1-9ea5-5299637c36f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.965611 Jan 28 01:25:17.248809 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 17/48] 10.222.0.16 () {62 vars in 1187 bytes} [Fri Jan 28 01:25:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 4971 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 01:25:17.259684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-84a10d16-38e2-4838-b74c-9f820e770084 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c303820>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:17.326760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-84a10d16-38e2-4838-b74c-9f820e770084 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] HTTP exception thrown: Volume 0f801089-0ef4-4ea1-be7a-9ebd1bb4913d could not be found. Jan 28 01:25:17.330975 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-84a10d16-38e2-4838-b74c-9f820e770084 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Returning 404 to user: Volume 0f801089-0ef4-4ea1-be7a-9ebd1bb4913d could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:17.334735 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-84a10d16-38e2-4838-b74c-9f820e770084 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d" status: 404 len: 109 microversion: 2.1 time: 0.084050 Jan 28 01:25:17.335554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 18/49] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:17 2022] GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:17.351592 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:17.357529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:17.401374 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:17.402580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:17.409427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:17.411767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:18.228158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:18.240210 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3b889023-d5f6-4a6d-8f89-2ccf8662240b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 1.584676 Jan 28 01:25:18.240935 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 32/50] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:16 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:18.262946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:18.263593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:18.289879 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:18.290622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:18.291498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:18.291945 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:18.564673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:18.582302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a8f65fc0-2592-44eb-ac09-e0751c5d8495 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1218 microversion: 2.1 time: 0.332362 Jan 28 01:25:18.586417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 33/51] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:18 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1218 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:18.599966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-63bf2f62-8987-48ab-8637-87b2033b215e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:18.600619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-63bf2f62-8987-48ab-8637-87b2033b215e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:18.869150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-63bf2f62-8987-48ab-8637-87b2033b215e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:18.876922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-63bf2f62-8987-48ab-8637-87b2033b215e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:18.878459 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-63bf2f62-8987-48ab-8637-87b2033b215e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:18.887446 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-63bf2f62-8987-48ab-8637-87b2033b215e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1280 microversion: 2.20 time: 0.291325 Jan 28 01:25:18.888291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 34/52] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:18 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1280 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:18.902023 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-29efa629-363e-4999-bf8c-a7bdd8fd1074 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c238820>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:19.023229 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-29efa629-363e-4999-bf8c-a7bdd8fd1074 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] HTTP exception thrown: Volume 0f801089-0ef4-4ea1-be7a-9ebd1bb4913d could not be found. Jan 28 01:25:19.023829 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-29efa629-363e-4999-bf8c-a7bdd8fd1074 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Returning 404 to user: Volume 0f801089-0ef4-4ea1-be7a-9ebd1bb4913d could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:19.024910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-29efa629-363e-4999-bf8c-a7bdd8fd1074 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d" status: 404 len: 109 microversion: 2.1 time: 0.135481 Jan 28 01:25:19.025692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 35/53] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jan 28 01:25:18 2022] DELETE /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:25:19.040969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-91f966b7-34b2-47b6-93a7-37069a122688 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Calling method '.version_select at 0x7f7e7c256940>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:19.093366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-91f966b7-34b2-47b6-93a7-37069a122688 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] HTTP exception thrown: Volume 0f801089-0ef4-4ea1-be7a-9ebd1bb4913d could not be found. Jan 28 01:25:19.094116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-91f966b7-34b2-47b6-93a7-37069a122688 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] Returning 404 to user: Volume 0f801089-0ef4-4ea1-be7a-9ebd1bb4913d could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:25:19.095635 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-91f966b7-34b2-47b6-93a7-37069a122688 tempest-VolumesSnapshotsTestJSON-1507578189 tempest-VolumesSnapshotsTestJSON-1507578189-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d" status: 404 len: 109 microversion: 2.1 time: 0.063832 Jan 28 01:25:19.099310 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 36/54] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:25:19 2022] GET /compute/v2.1/os-volumes/0f801089-0ef4-4ea1-be7a-9ebd1bb4913d => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:25:19.150079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:19.182472 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a82a791f-ec71-47bf-89de-722e684250a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 1.839823 Jan 28 01:25:19.186875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 19/55] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:17 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:19.274231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:19.274915 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:19.307354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:19.313150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:19.318795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:19.320841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:19.613380 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:19.614080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:19.646019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:19.646725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:19.649949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:19.651554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:19.922252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:19.943921 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-eb6685a3-a529-4139-b35e-a62b7e518893 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1274 microversion: 2.1 time: 0.334431 Jan 28 01:25:19.955720 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 20/56] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:19 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1274 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:19.969977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:19.977970 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:19.988581 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:20.002086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:20.003297 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:20.003943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:20.493915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:20.511271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:20.523997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:20.524872 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b811f43a-626f-4e6c-8480-ad8e030ea65b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1332 microversion: 2.20 time: 0.567856 Jan 28 01:25:20.525603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 21/57] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:19 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1332 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:20.530503 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:20.534662 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:20.541222 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:20.541978 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:20.543205 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:20.543841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:20.762258 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:20.772292 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7bfb08e3-bd48-4bbb-b636-0232f719a057 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 1.504837 Jan 28 01:25:20.773658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 37/58] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:19 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:20.981927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:20.984735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:21.000754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:21.002319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:21.005949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:21.006813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:21.223564 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:21.235526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b86925de-9b03-488f-b2a1-d5036df899a8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1280 microversion: 2.1 time: 0.267290 Jan 28 01:25:21.237471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 38/59] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:20 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1280 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:21.317043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:21.325876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6296c12c-bac4-46ed-805a-86501bf240da tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.798887 Jan 28 01:25:21.326805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 22/60] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:20 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:21.563284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:21.563904 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:21.578724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:21.579190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:21.579952 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:21.580379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:21.742336 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:21.759461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:21.764440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:21.768005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4577ad84-89f0-4401-bb9f-f4d7446d4fd9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1332 microversion: 2.20 time: 0.211991 Jan 28 01:25:21.781861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 39/61] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:21 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1332 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:21.791085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:21.791734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:21.798235 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:21.798687 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:21.799477 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:21.800117 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.262315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:22.267132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:22.277323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.278765 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.279862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.280479 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.468190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:22.478317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-47f69583-72fe-4e6b-8043-395ab6dd7e44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1280 microversion: 2.1 time: 0.227696 Jan 28 01:25:22.483055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 40/62] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:22 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1280 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:22.494677 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:22.495602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:22.510993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.514696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.515853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.516319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.599577 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:22.616719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f669cd4d-87c7-4216-b0b8-451eef7eae61 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.821464 Jan 28 01:25:22.634548 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 23/63] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:21 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:22.882838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-ff1f3e8c-7695-4fad-8a98-268dad2d80ac req-cd880f9d-d833-45cb-ab93-af20f3d4c9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fb90ad9-31f4-41d7-968a-3a0b4d183734", "tag": "8aa5043e-3152-48fe-a672-71b585f0fe26"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:22.886245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:22.886245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:25:22.901370 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ff1f3e8c-7695-4fad-8a98-268dad2d80ac req-cd880f9d-d833-45cb-ab93-af20f3d4c9e2 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.902097 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ff1f3e8c-7695-4fad-8a98-268dad2d80ac req-cd880f9d-d833-45cb-ab93-af20f3d4c9e2 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.935801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:22.937028 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-ff1f3e8c-7695-4fad-8a98-268dad2d80ac req-cd880f9d-d833-45cb-ab93-af20f3d4c9e2 service nova] Creating event network-changed:8aa5043e-3152-48fe-a672-71b585f0fe26 for instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 on hv-cinder-82662 Jan 28 01:25:22.937945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ff1f3e8c-7695-4fad-8a98-268dad2d80ac req-cd880f9d-d833-45cb-ab93-af20f3d4c9e2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116163) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 01:25:22.939975 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.940682 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.941938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.942506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.943698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1dc793d0-ce67-4ddf-b2d8-254ef72c15bb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.453015 Jan 28 01:25:22.944271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 41/64] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:22 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:22.957356 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:22.957927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:22.965534 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.compute.rpcapi [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 01:25:22.966974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] Releasing lock "compute-rpcapi-router" {{(pid=116163) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 01:25:22.981975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.984033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.985139 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:22.987162 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:22.989204 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-548b5d0c-e179-4cf9-96fd-b56adae65565 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.351679 Jan 28 01:25:22.990497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 24/65] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:23.061101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:23.069499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:23.070981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:23.072300 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-349b8249-253f-4d44-b859-646aaa3f0f4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1332 microversion: 2.20 time: 0.125605 Jan 28 01:25:23.072811 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 42/66] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:22 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:23.497039 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:23.498465 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:23.520168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:23.520637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:23.521642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:23.522087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:23.641703 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:23.642649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:23.656949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:23.658229 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:23.660955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:23.661462 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:23.731470 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:23.775722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b3ca77ed-e6be-49c6-9fa1-fbb9c4d0ba99 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1280 microversion: 2.1 time: 0.273425 Jan 28 01:25:23.805215 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 25/67] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:23 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:23.964723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:23.965890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:23.978173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:23.979409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:23.981361 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:23.982499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:24.031034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:24.055800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d363d4df-dfcf-4b0f-be2f-19aecc1d5d2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.422740 Jan 28 01:25:24.056967 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 43/68] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:23 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:24.097132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:24.098278 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:24.140345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:24.140920 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:24.142503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:24.143540 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:24.295297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:24.327488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:24.352563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6eed902a-35b4-4de6-891a-257a6b69e234 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.395109 Jan 28 01:25:24.353433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 26/69] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:23 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:24.357368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:24.359228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:24.360978 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-24f6d594-752f-4053-85e2-0fbb1deddd78 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1332 microversion: 2.20 time: 0.272053 Jan 28 01:25:24.362152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 44/70] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:24 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1332 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:25:24.806412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:24.809781 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:24.846498 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:24.849755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:24.852845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:24.854140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.035249 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-e7bd91f6-df75-49fd-a1cc-73fe653a638e req-0b2b854c-14f5-403b-b017-1370c89c7cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92a6de0f-2d0d-4667-aa75-cdfa602b2385", "tag": "59cce6ec-860d-4d1c-bf82-0e624e2e27cb"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:25.036689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:25.036689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:25:25.095592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e7bd91f6-df75-49fd-a1cc-73fe653a638e req-0b2b854c-14f5-403b-b017-1370c89c7cfa service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.096485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e7bd91f6-df75-49fd-a1cc-73fe653a638e req-0b2b854c-14f5-403b-b017-1370c89c7cfa service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.133835 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:25.176878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7c2ab717-f105-45d0-b143-7ca4ed57e247 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1280 microversion: 2.1 time: 0.382569 Jan 28 01:25:25.187865 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-e7bd91f6-df75-49fd-a1cc-73fe653a638e req-0b2b854c-14f5-403b-b017-1370c89c7cfa service nova] Creating event network-changed:59cce6ec-860d-4d1c-bf82-0e624e2e27cb for instance 92a6de0f-2d0d-4667-aa75-cdfa602b2385 on hv-cinder-82662 Jan 28 01:25:25.188761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e7bd91f6-df75-49fd-a1cc-73fe653a638e req-0b2b854c-14f5-403b-b017-1370c89c7cfa service nova] Acquired lock "compute-rpcapi-router" {{(pid=116162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 28 01:25:25.192764 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 27/71] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:24 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1280 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:25.194835 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.197175 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.204802 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:25.206902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.207533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:25.208123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.234989 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.compute.rpcapi [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 28 01:25:25.237055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] Releasing lock "compute-rpcapi-router" {{(pid=116162) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 28 01:25:25.244473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.245087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.249059 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.249723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.286752 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2a86a383-d227-473c-bfca-9d47c729201b None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259531 Jan 28 01:25:25.288695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 45/72] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:25.380819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:25.385007 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:25.430100 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.434687 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:25.440708 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:25.444000 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:26.550870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:26.576501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9f8b9e3c-80fc-402c-a663-f4ec8a105a2d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 1.382564 Jan 28 01:25:26.577615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 28/73] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:25 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:26.583279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:26.584380 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:26.592569 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:26.595697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:26.595697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:26.595697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:26.681602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:26.691791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-43133701-8705-4484-ab3a-ba130fc1d564 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 1.323599 Jan 28 01:25:26.693028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 46/74] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:25 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:26.698159 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:26.699165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:26.706114 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:26.707595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:26.709143 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:26.709757 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:26.776076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:26.798921 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:26.800694 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:26.802029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-56844536-66e8-4c76-a733-18d5968ecac3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.223271 Jan 28 01:25:26.802583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 29/75] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:26 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:26.965563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:26.973579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2b06341d-21d1-4b23-bf43-82034da3db95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.279102 Jan 28 01:25:26.974375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 47/76] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:26 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:27.306777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-af1eb890-dc25-43fd-8c79-a85444e5dabd req-e287a586-e5ac-4749-924c-2ce1b653d082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96d2486b-d99e-4c1b-b15e-173a27da5960", "tag": "3399ad7b-0a30-47fc-87d4-cf5cc2205cf5"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:27.308589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:27.308589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:25:27.317549 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-af1eb890-dc25-43fd-8c79-a85444e5dabd req-e287a586-e5ac-4749-924c-2ce1b653d082 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.318002 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-af1eb890-dc25-43fd-8c79-a85444e5dabd req-e287a586-e5ac-4749-924c-2ce1b653d082 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.330599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-af1eb890-dc25-43fd-8c79-a85444e5dabd req-e287a586-e5ac-4749-924c-2ce1b653d082 service nova] Creating event network-changed:3399ad7b-0a30-47fc-87d4-cf5cc2205cf5 for instance 96d2486b-d99e-4c1b-b15e-173a27da5960 on hv-cinder-82662 Jan 28 01:25:27.336615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-af1eb890-dc25-43fd-8c79-a85444e5dabd req-e287a586-e5ac-4749-924c-2ce1b653d082 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033903 Jan 28 01:25:27.337246 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 30/77] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:27.594433 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:27.595052 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:27.601005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.601484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.602251 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.602672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.710474 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:27.711318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:27.717877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.718323 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.719113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.719565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.739217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:27.747021 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d6b0dae7-890c-4d3c-b931-823bd664e717 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.156047 Jan 28 01:25:27.749370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 48/78] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:27 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:27.819877 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:27.820477 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:27.826952 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.827395 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.828177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:27.828605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:27.858361 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:27.866334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c28bb996-370a-4f17-b845-c86327ca08a2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.160168 Jan 28 01:25:27.867148 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 31/79] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:27 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:27.892689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:27.900806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:27.903490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:27.904645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-52a1101a-682c-4941-a64f-da34e813a0e6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.088607 Jan 28 01:25:27.905247 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 49/80] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:27 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:27.994328 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:27.995174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:28.004736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.005647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.006990 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.007721 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.143382 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:28.151989 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-956915ef-4436-4caf-9bd7-4c2e9585b06c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.163254 Jan 28 01:25:28.152725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 32/81] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:27 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:28.764122 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:28.764725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:28.771693 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.774536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.774536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.774536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.883889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:28.884322 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:28.890313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.890756 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.891546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.891935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.914829 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:28.923218 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cb1f1e48-e940-4820-a7ae-a390ccf19a53 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.162984 Jan 28 01:25:28.923800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 50/82] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:28 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:28.928296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:28.928909 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:28.937131 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.937611 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:28.938432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:28.939104 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:29.040127 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:29.060290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:29.064669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:29.066755 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9b04f2ea-c8ac-49d0-8eef-f6c669e72f3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.141723 Jan 28 01:25:29.068706 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 51/83] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:28 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:29.108384 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:29.122015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-99a2e12f-1667-46e7-b456-a8cbdd5823d5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.241165 Jan 28 01:25:29.123096 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 33/84] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:28 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:29.171168 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:29.171815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:29.181494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:29.181941 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:29.182734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:29.183165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:29.389864 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:29.401531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1d095e03-e004-4b88-a94a-2249b6a6b22e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.233782 Jan 28 01:25:29.403083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 52/85] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:29 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:29.940545 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:29.941455 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:29.955345 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:29.960481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:29.963946 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:29.964748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.089727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:30.091147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:30.113752 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:30.116347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.118428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:30.119164 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.218406 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:30.229321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-97a199ef-3d6e-4a55-91f6-78d6cb241353 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.292465 Jan 28 01:25:30.231779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 34/86] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:29 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:30.236642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:30.237540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:30.244355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:30.245324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.246500 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:30.247082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.335688 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:30.344930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:30.362187 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:30.363830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-85e53cf3-b2d7-4621-9582-2589607cccab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.278404 Jan 28 01:25:30.364428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 53/87] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:30 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:30.420335 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:30.420946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:30.436959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:30.439461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.441031 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:30.446787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:30.588414 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:30.596563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bfd92a50-d406-44da-928e-bfb8db35e6d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.363395 Jan 28 01:25:30.597162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 35/88] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:30 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:30.716140 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:30.724827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5eaa8ea1-9151-4db3-bfc2-55dfab1a9bd5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.308318 Jan 28 01:25:30.725356 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 54/89] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:30 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:31.254487 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:31.255764 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:31.262069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.262509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.263305 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.263896 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.384624 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:31.385726 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:31.393199 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.393797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.394671 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.395101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.413007 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:31.421543 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-38e01891-f437-4d79-a024-660f4fadfcbd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.170905 Jan 28 01:25:31.422519 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 36/90] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:31 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:31.464645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:31.475499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:31.479243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:31.479243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e606f881-ee57-450a-975d-a8af13d9aced tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.098013 Jan 28 01:25:31.479243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 55/91] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:31 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:31.629327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:31.629327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:31.634069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.634291 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.635096 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.635530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.745392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:31.746446 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:31.755394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.756163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:31.757317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:31.758187 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:32.109570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:32.116955 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-66e2ac94-0e6e-4357-8166-f5bea6984047 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.506234 Jan 28 01:25:32.117596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 37/92] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:31 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:32.135918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:32.143814 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bba82f52-2587-4e7f-9ee4-88a0a0fe462c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.403615 Jan 28 01:25:32.144808 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 56/93] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:31 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:32.191974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-d5fda963-d627-422c-8f1b-d77e13f33b9c req-774b1a1a-cdcf-441e-bf22-fcff28709c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae", "tag": "ea29b944-0e8c-4c3a-be50-a3fd52f71b74"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:32.194718 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:32.194718 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:25:32.205701 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-d5fda963-d627-422c-8f1b-d77e13f33b9c req-774b1a1a-cdcf-441e-bf22-fcff28709c81 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:32.206163 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-d5fda963-d627-422c-8f1b-d77e13f33b9c req-774b1a1a-cdcf-441e-bf22-fcff28709c81 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:32.224703 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-d5fda963-d627-422c-8f1b-d77e13f33b9c req-774b1a1a-cdcf-441e-bf22-fcff28709c81 service nova] Creating event network-changed:ea29b944-0e8c-4c3a-be50-a3fd52f71b74 for instance 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae on hv-cinder-82662 Jan 28 01:25:32.230185 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-d5fda963-d627-422c-8f1b-d77e13f33b9c req-774b1a1a-cdcf-441e-bf22-fcff28709c81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111153 Jan 28 01:25:32.230955 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 38/94] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:32.438988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:32.439561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:32.448413 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:32.448820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:32.449754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:32.450200 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:32.497849 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:32.498722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:32.505464 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:32.506058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:32.506961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:32.507717 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:32.597856 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:32.607165 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:32.608854 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:32.615359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5060970a-7859-461c-b80c-372620e0cd68 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.116606 Jan 28 01:25:32.616029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 39/95] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:32 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:25:32.636546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:32.645000 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1208592f-28ae-40c4-a151-5f5a3b919d2a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.210079 Jan 28 01:25:32.645721 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 57/96] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:32 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:33.134662 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:33.135282 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:33.141931 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.142394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.143236 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.143732 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.160363 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:33.161475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:33.167712 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.168299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.169626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.170078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.349447 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:33.358760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f94052cc-e62a-4d38-8626-0ba656555579 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.227986 Jan 28 01:25:33.359235 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 40/97] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:33 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:33.374123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:33.381940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8c96befc-6fe9-409d-a5d9-58f15e682858 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.225186 Jan 28 01:25:33.382540 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 58/98] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:33 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:33.635492 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:33.636248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:33.642937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.643553 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.644360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.644798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.661966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:33.662606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:33.669399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.669551 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.670827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:33.671174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:33.718027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:33.727177 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:33.728669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:33.729823 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-eeecd7ef-c108-4119-a508-f8ab853b38ef tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.098985 Jan 28 01:25:33.730793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 41/99] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:33 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:33.839799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:33.852490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31578450-e2ce-4ebf-a70f-7a16125713ab tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.193838 Jan 28 01:25:33.853651 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 59/100] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:33 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:34.386333 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:34.388013 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:34.403636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:34.404824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:34.406496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:34.407090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:34.411470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:34.412504 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:34.440843 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:34.442137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:34.444065 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:34.446206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:35.126777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:35.134368 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1e95d7c9-263a-4697-a0cc-ad4fcdfeb253 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.760336 Jan 28 01:25:35.134961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 42/101] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:34 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:35.145265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:35.145265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:35.164808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:35.165485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:35.166464 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:35.166890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:35.250497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:35.263141 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-40f22442-fbdb-4136-bfee-680820baf50d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.866301 Jan 28 01:25:35.263838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 60/102] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:34 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:35.273605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:35.278100 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:35.295330 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:35.295785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:35.296583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:35.297013 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:35.362597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:35.379537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:35.387190 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:35.388887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0b139e0a-2c10-4107-b92e-688d51635913 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1338 microversion: 2.20 time: 0.252954 Jan 28 01:25:35.391731 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 43/103] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:35 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1338 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:35.712131 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:35.722175 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fff1e308-96e7-4da1-9ba9-2c303dec9ffd tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.456844 Jan 28 01:25:35.724517 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 61/104] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:35 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:36.153649 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:36.155007 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:36.170020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:36.173320 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:36.177016 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:36.178673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:36.290354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:36.292412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:36.343345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:36.344847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:36.348340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:36.356899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:37.224258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:37.273610 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a8f1858c-f088-4d7f-bb26-706f6da5560c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 1.114691 Jan 28 01:25:37.274902 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 44/105] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:36 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:37.284915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:37.285640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:37.310956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:37.311408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:37.312258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:37.312887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:37.367668 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:37.377654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6645b2f9-9680-4a21-bd15-95c698b9edee tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 1.099480 Jan 28 01:25:37.395654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 62/106] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:36 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:37.401328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:37.401977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:37.429115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:37.429701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:37.430537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:37.430979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:37.816175 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:37.823856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:37.825461 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:37.827587 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:37.829281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f4afa67b-06f7-46ca-b5d9-9672ea65b794 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.553247 Jan 28 01:25:37.830629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 45/107] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:37 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:37.833604 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4e387ae1-c007-4d69-b8f4-51522b2131bf tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.436362 Jan 28 01:25:37.834977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 63/108] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:37 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:37.846637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-25af2e2e-3d60-43c3-af9d-f4bfb600d3f4 req-e68241a3-4eab-4ea2-97f1-09c0ec027703 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:37.848615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:37.848615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:25:37.856522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-25af2e2e-3d60-43c3-af9d-f4bfb600d3f4 req-e68241a3-4eab-4ea2-97f1-09c0ec027703 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:37.856966 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-25af2e2e-3d60-43c3-af9d-f4bfb600d3f4 req-e68241a3-4eab-4ea2-97f1-09c0ec027703 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:37.870142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-25af2e2e-3d60-43c3-af9d-f4bfb600d3f4 req-e68241a3-4eab-4ea2-97f1-09c0ec027703 service nova] Creating event network-changed:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:25:37.875551 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-25af2e2e-3d60-43c3-af9d-f4bfb600d3f4 req-e68241a3-4eab-4ea2-97f1-09c0ec027703 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043511 Jan 28 01:25:37.876149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 46/109] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:38.293031 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:38.293689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:38.300636 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.301081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.302267 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.302898 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.400872 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:38.401618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:38.408318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.408825 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.409693 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.410350 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.465993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:38.474061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-32b7ef21-8771-4e9a-a70c-253fd0a80ccb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.186081 Jan 28 01:25:38.474796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 64/110] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:38 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:38.554674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:38.563510 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c640dcca-2e08-4b12-b668-0bb1260dc063 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.166811 Jan 28 01:25:38.564109 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 47/111] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:38 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:38.847896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:38.848458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:38.852425 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:38.853052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:38.854454 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.854905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.855928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.856833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.860272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.860914 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:38.861747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:38.862208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:39.065260 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:39.068838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:39.073686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:39.075273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:39.076362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6c21980c-5db2-44f6-98a8-01fdc61980a4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.228298 Jan 28 01:25:39.076691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6c36e66a-4133-42a6-a989-895bf662095e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.232383 Jan 28 01:25:39.077453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 65/112] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:38 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:39.087105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 48/113] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:38 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:39.490991 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:39.491739 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:39.498430 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:39.498963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:39.499797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:39.500295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:39.580233 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:39.581538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:39.588131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:39.588590 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:39.589639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:39.590310 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:39.679322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:39.686923 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-912833aa-ac84-407e-b2c2-0ec9a972b350 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.199911 Jan 28 01:25:39.696452 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 66/114] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:39 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:39.759776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:39.767576 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5c736c9e-d572-447c-9d51-0c7c9789495a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.191175 Jan 28 01:25:39.768316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 49/115] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:39 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:40.119190 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:40.119717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:40.122420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:40.127125 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:40.145963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:40.147354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:40.150420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:40.151058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:40.151941 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:40.152439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:40.156134 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:40.157766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:40.907363 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:40.919541 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e7b62541-6d5f-424d-b53c-bcff994559b4 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.824600 Jan 28 01:25:40.921158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 67/116] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:40 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:40.936460 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:40.937948 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:40.955747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:40.959432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:40.960545 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:40.962930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:40.991030 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:41.016452 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:41.027372 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:41.030605 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3d8fe3fc-43bd-463e-9d90-a5e98d2cd614 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.936449 Jan 28 01:25:41.031480 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 50/117] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:40 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:41.048010 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:41.054023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:41.071965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:41.076789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:41.078437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:41.079360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:41.965586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:41.973449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:41.975115 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f9ef8228-b5f2-43c8-b5b6-a6be14a5d35a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.940825 Jan 28 01:25:41.983440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f1159836-4e7d-4fbe-b7d2-cbba00f53328 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 1.060633 Jan 28 01:25:41.984333 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 68/118] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:40 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:41.985220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 51/119] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:41 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:41.992056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:41.993376 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:42.003208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:42.004019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:42.005313 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:42.006110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:42.063218 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:42.065248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:42.074941 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:42.076239 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:42.078031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:42.079021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:42.382183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:42.395244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0d8d8a0a-d830-42b0-b7b7-1a8c0a164b92 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.409662 Jan 28 01:25:42.395876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 69/120] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:41 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:42.475001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:42.489844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:42.494438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:42.497123 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6cbe4019-3068-4154-8126-1fc364194baa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.437643 Jan 28 01:25:42.511129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 52/121] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:42 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:43.001054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:43.002019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:43.005941 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:43.006602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:43.013608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.014056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.014888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.015379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.023233 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.023681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.024727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.025195 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.387872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:43.399725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1b424b5d-377c-4099-8828-6338c59a2d85 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.409434 Jan 28 01:25:43.401426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 70/122] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:42 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:43.417277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:43.417960 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:43.421860 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:43.433710 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.433811 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2e071b1e-e419-4142-b09e-def3091045cc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.436199 Jan 28 01:25:43.433922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.435080 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.435184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 53/123] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:42 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:43.435502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.528734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:43.529821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:43.540879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.541669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.543900 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:43.545968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:43.741163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:43.755391 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5fbd7e6f-534e-4150-8820-4d4a9bf72255 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.341756 Jan 28 01:25:43.757219 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 71/124] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:43 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:43.851155 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:43.860848 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:43.862459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:43.863816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c3d3c071-6eaa-4f77-9f88-865e491e85c1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.341791 Jan 28 01:25:43.864421 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 54/125] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:43 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:25:44.426293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:44.426909 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:44.432954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.433443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.434298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.434722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.456195 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:44.456943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:44.464080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.464540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.465456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.465903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.668928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:44.677514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fa1bd6a3-208d-4904-8f49-8542e8ff6e88 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.254717 Jan 28 01:25:44.678090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 72/126] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:44 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:44.689002 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:44.696627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4e1a89a3-70bb-4b60-bacc-db6315cf4365 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.244029 Jan 28 01:25:44.697197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 55/127] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:44 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:44.783966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:44.784994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:44.794056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.794751 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.795964 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.796569 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.888651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:44.889385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:44.902009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.902854 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:44.903793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:44.904338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:45.003760 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:45.012574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a8b6d717-5173-462a-8bb1-93cc4791756d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.237662 Jan 28 01:25:45.013156 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 73/128] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:44 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:45.096749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:45.107865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:45.109584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:45.110666 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cb42f2c7-19ce-4996-bdc7-e31b1622083f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.228671 Jan 28 01:25:45.111630 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 56/129] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:44 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:25:45.704655 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:45.705398 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:45.715209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:45.715424 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:45.725191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:45.725536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:45.725536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:45.725536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:45.730308 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:45.730812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:45.731652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:45.732089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:45.947248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:45.950911 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:45.955105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cbdb9d5d-fb19-4cde-9f57-a5e1820376a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.243855 Jan 28 01:25:45.955887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 57/130] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:45 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:45.959166 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-da7fde88-f425-4157-8b63-0b2f30298774 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.260629 Jan 28 01:25:45.959744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 74/131] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:45 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:46.029948 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:46.030586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:46.037244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.037714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.038519 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.038952 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.129469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:46.130094 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:46.136701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.137159 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.138075 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.138818 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.197034 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:46.205278 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7ebd924a-73ff-4c70-9c91-344664164466 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.179058 Jan 28 01:25:46.206003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 58/132] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:46 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:46.311548 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:46.320176 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:46.321720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:46.322850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ab3eea2e-d988-45de-8a2e-af7f5902bc52 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.197248 Jan 28 01:25:46.323429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 75/133] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:46 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:46.975157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:46.976163 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:46.978051 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:46.979296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:46.984357 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.985158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.986686 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.987044 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.987433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.987907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:46.989307 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:46.990174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:47.231710 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:47.240377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-44e1b027-5a46-4408-8dbf-1a21189f1577 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.267151 Jan 28 01:25:47.250137 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:47.251085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 76/134] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:46 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:47.256442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:47.257538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:47.259369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2abb35ac-b4a0-449b-95a6-e3aea5f20c4d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.289564 Jan 28 01:25:47.269064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 59/135] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:46 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:47.275142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:47.275586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:47.276389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:47.276812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:47.340509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:47.341121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:47.356647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:47.358450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:47.359784 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:47.362644 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:47.511461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:47.522912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-db53d20b-7752-4d60-a571-90b5d6eed528 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.270324 Jan 28 01:25:47.523899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 77/136] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:47 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:47.620015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:47.630105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-66ddddf1-ac8c-400d-94c5-3ccdcbc116d1 req-5a1bf285-65fc-4563-b400-f61e0f40b314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae", "name": "network-vif-plugged", "status": "completed", "tag": "ea29b944-0e8c-4c3a-be50-a3fd52f71b74"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:47.636273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:47.636273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:25:47.651873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:47.664401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:47.664684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-66ddddf1-ac8c-400d-94c5-3ccdcbc116d1 req-5a1bf285-65fc-4563-b400-f61e0f40b314 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:47.665417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-66ddddf1-ac8c-400d-94c5-3ccdcbc116d1 req-5a1bf285-65fc-4563-b400-f61e0f40b314 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:47.667579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-feb06bc6-cac5-4347-8a7b-a105ed7792b7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.330970 Jan 28 01:25:47.671454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 60/137] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:47 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:25:47.683594 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-66ddddf1-ac8c-400d-94c5-3ccdcbc116d1 req-5a1bf285-65fc-4563-b400-f61e0f40b314 service nova] Creating event network-vif-plugged:ea29b944-0e8c-4c3a-be50-a3fd52f71b74 for instance 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae on hv-cinder-82662 Jan 28 01:25:47.695579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-66ddddf1-ac8c-400d-94c5-3ccdcbc116d1 req-5a1bf285-65fc-4563-b400-f61e0f40b314 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168368 Jan 28 01:25:47.696342 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 78/138] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:48.262606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:48.263417 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:48.271408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.271408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.271756 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.272178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.281949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:48.281949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:48.301202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.301202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.301202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.301753 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.576589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:48.589554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:48.612313 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f4bd1305-379d-4dfa-b5c3-c05da0077bfd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.338472 Jan 28 01:25:48.613042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-30c63ed7-1f5d-4fb0-8180-2a212dc3e0bf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.349259 Jan 28 01:25:48.638622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 79/139] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:48 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:48.640391 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 61/140] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:48 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:48.645965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:48.646928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:48.664807 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.665327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.666143 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.666655 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.688391 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:48.689095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:48.704870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.705563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.706409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:48.706844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:48.941767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:48.959870 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fa8ac605-5cf6-48d8-95d2-5ba8fb7b1eb8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.319498 Jan 28 01:25:48.961901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 80/141] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:48 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:48.995252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:49.010984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:49.014353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:49.015833 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1f04322b-e5aa-4624-8aee-e4aa4b5fb556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.331724 Jan 28 01:25:49.016727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 62/142] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:48 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:25:49.656667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:49.657287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:49.663874 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.664325 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:49.665105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.665605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:49.667419 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:49.668100 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:49.674653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.675103 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:49.675895 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.676326 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:49.867443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:49.872364 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:49.876283 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-eff8b34c-ac6c-4d86-a78c-3ea7436790b5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.223318 Jan 28 01:25:49.876860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 81/143] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:49 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:49.882378 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb90ad9-31f4-41d7-968a-3a0b4d183734", "name": "network-vif-plugged", "status": "completed", "tag": "8aa5043e-3152-48fe-a672-71b585f0fe26"}, {"server_uuid": "92a6de0f-2d0d-4667-aa75-cdfa602b2385", "name": "network-vif-plugged", "status": "completed", "tag": "59cce6ec-860d-4d1c-bf82-0e624e2e27cb"}, {"server_uuid": "96d2486b-d99e-4c1b-b15e-173a27da5960", "name": "network-vif-plugged", "status": "completed", "tag": "3399ad7b-0a30-47fc-87d4-cf5cc2205cf5"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:49.884722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:49.884722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:25:49.888994 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5a1eb601-9ee0-4aec-92dc-3e5c8d45bce5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.225167 Jan 28 01:25:49.889749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 63/144] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:49 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:49.894275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.894722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:49.908929 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] Creating event network-vif-plugged:8aa5043e-3152-48fe-a672-71b585f0fe26 for instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 on hv-cinder-82662 Jan 28 01:25:49.909474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] Creating event network-vif-plugged:59cce6ec-860d-4d1c-bf82-0e624e2e27cb for instance 92a6de0f-2d0d-4667-aa75-cdfa602b2385 on hv-cinder-82662 Jan 28 01:25:49.909993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] Creating event network-vif-plugged:3399ad7b-0a30-47fc-87d4-cf5cc2205cf5 for instance 96d2486b-d99e-4c1b-b15e-173a27da5960 on hv-cinder-82662 Jan 28 01:25:49.918593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-b68bf7b2-0a67-43f2-ac58-9291f611a6de req-d45574ba-b067-49f9-b4e3-55aead7b4ee8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.039744 Jan 28 01:25:49.919632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 82/145] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:49.979909 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:49.980542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:49.987315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.988098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:49.989060 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:49.989589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:50.038632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:50.039366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:50.047810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:50.047810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:50.047810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:50.048179 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:50.172979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:50.182047 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4cc64133-f911-4c81-b926-fdba535c4c0d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.205427 Jan 28 01:25:50.182965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 64/146] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:49 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:50.250155 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:50.258763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:50.260458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:50.262020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b0d3e4b8-2016-4adf-8db5-723ebd51e1c8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.227419 Jan 28 01:25:50.262819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 83/147] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:50 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:50.893749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:50.894301 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:50.901351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:50.901798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:50.902879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:50.903322 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:50.906321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:50.906932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:50.913486 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:50.913926 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:50.914714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:50.915137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:51.110286 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:51.118462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-723837d7-ad48-4c3d-a8eb-5e6084c01bdf tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.228498 Jan 28 01:25:51.119061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 65/148] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:50 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:51.123068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:51.131207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2498c43d-0a73-4d5c-b6ad-6288ed6da577 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.228558 Jan 28 01:25:51.131806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 84/149] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:50 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:51.199565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:51.200207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:51.207183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:51.207631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:51.208912 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:51.209339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:51.285842 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:51.286487 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:51.293600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:51.294334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:51.296277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:51.297374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:51.391101 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:51.402554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-93c18205-42c3-4fb7-bed0-c47e726be20e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.206362 Jan 28 01:25:51.403842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 66/150] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:51 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:51.485207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:51.493413 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:51.494919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:51.496165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-90ee02e7-ff6a-48c6-a0c8-c3b60203b235 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.214117 Jan 28 01:25:51.496714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 85/151] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:51 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:52.136260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:52.136847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:52.143651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.144095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.144887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.145353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.148135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:52.148727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:52.155740 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.156190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.156993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.157482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.353470 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:52.367593 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-888901cc-6d61-4374-bac6-80f548e515ae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.234804 Jan 28 01:25:52.368358 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 67/152] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:52 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:52.394901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:52.405685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b4161322-fca5-422a-8ee7-7bcd2d919600 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.261229 Jan 28 01:25:52.409359 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 86/153] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:52 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:52.431497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:52.434014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:52.453204 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.453678 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.456696 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.457554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.519619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:52.520811 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:52.550791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.555297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.562890 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.563761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.841453 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:52.858576 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-566d07b1-ee95-4784-9fd1-75fcf272b73a tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.438263 Jan 28 01:25:52.871327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 68/154] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:52 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:52.876895 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-ffc0f728-fd88-4dea-9c15-e952dd4f197d req-ca09a182-7a10-41e0-867e-67f8f7340ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "name": "network-vif-plugged", "status": "completed", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:25:52.878855 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:25:52.878855 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:25:52.886366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ffc0f728-fd88-4dea-9c15-e952dd4f197d req-ca09a182-7a10-41e0-867e-67f8f7340ee6 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:52.887028 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ffc0f728-fd88-4dea-9c15-e952dd4f197d req-ca09a182-7a10-41e0-867e-67f8f7340ee6 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:52.899422 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-ffc0f728-fd88-4dea-9c15-e952dd4f197d req-ca09a182-7a10-41e0-867e-67f8f7340ee6 service nova] Creating event network-vif-plugged:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:25:52.905362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-ffc0f728-fd88-4dea-9c15-e952dd4f197d req-ca09a182-7a10-41e0-867e-67f8f7340ee6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032381 Jan 28 01:25:52.906590 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 69/155] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:25:52.984463 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:53.007884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:53.009930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:53.012136 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5a59be18-c378-4d75-a9fa-52b1b907aae8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.500733 Jan 28 01:25:53.014042 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 87/156] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:52 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:53.388735 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:53.389995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:53.397944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:53.398465 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:53.399494 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:53.400005 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:53.432087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:53.433425 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:53.441736 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:53.442275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:53.443320 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:53.443966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:53.623754 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:53.642725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bcf97aa8-d4b4-42c9-bd56-b4f24df71f95 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.258290 Jan 28 01:25:53.643618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 70/157] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:53 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:53.684541 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:53.691956 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0cac598b-dbc6-4dea-969f-3857d19f3b22 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.264107 Jan 28 01:25:53.692533 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 88/158] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:53 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:53.879045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:53.880199 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:53.889056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:53.889711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:53.890816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:53.891304 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.033995 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:54.034943 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:54.043080 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:54.043529 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.044312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:54.044766 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.601636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:54.611051 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1798bfc0-1019-4d47-8bc1-ecec9124da47 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.738173 Jan 28 01:25:54.612160 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 71/159] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:53 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:54.665772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:54.666398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:54.673456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:54.673913 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.674751 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:54.675185 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.850214 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:54.859666 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:54.862969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:54.863721 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d19ba725-88d3-4940-bf63-a88d5b69927b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.833583 Jan 28 01:25:54.864469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 89/160] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:54 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:54.875005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:54.876451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:54.888879 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:54.889876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.891370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:54.892644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:54.952254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:54.970433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-29b91d93-1950-43d5-befc-9e50576a4a53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.308355 Jan 28 01:25:54.980256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 72/161] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:54 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:55.072377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:55.080718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c5a08eff-a331-4243-85d5-3b8e72be1554 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.214589 Jan 28 01:25:55.081358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 90/162] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:54 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:55.632266 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:55.632653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:55.638700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:55.639168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:55.639987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:55.640418 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:55.783864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:55.791805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ab971848-01a4-41da-94e0-9267d9e6be40 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.163515 Jan 28 01:25:55.792377 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 73/163] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:55 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:55.890548 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:55.892085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:55.898232 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:55.898657 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:55.899435 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:55.899852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:55.990509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:55.991203 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:55.997683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:55.998376 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:55.999249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:55.999754 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:56.054231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:56.062631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:56.064303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:56.065592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d78b7f92-8e86-4b61-a8b2-62e5129f3cf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.178884 Jan 28 01:25:56.066389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 91/164] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:55 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:56.106146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:56.106792 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:56.112907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:56.113457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:56.114244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:56.114664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:56.165978 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:56.174321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7c67d4d7-11c9-4629-a388-213e52ba4ee9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.190765 Jan 28 01:25:56.175340 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 74/165] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:55 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:56.256627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:56.264489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f17a2dd5-f737-4dcb-b4ed-a5ff821d1593 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.161984 Jan 28 01:25:56.265062 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 92/166] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:56 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:56.810003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:56.810866 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:56.821827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:56.822023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:56.824444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:56.825055 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.027889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:57.039444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bd8d71e0-42bc-434a-bcea-ed27726a26e6 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.234248 Jan 28 01:25:57.040386 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 75/167] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:56 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:57.084434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:57.085044 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:57.091534 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:57.092056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.093092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:57.093642 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.191608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:57.192560 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:57.199296 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:57.199934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.200740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:57.201265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.230572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:57.239210 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:57.241111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:57.242266 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-dbbb057d-7081-40cb-9aa7-9dbb07242665 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.162077 Jan 28 01:25:57.252995 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 93/168] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:57 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:57.286646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:57.287881 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:57.298759 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:57.299202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.299981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:57.300465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:57.380333 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:57.391873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-48cd4668-da4c-4cfa-847a-6dc34eca7d9a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.201482 Jan 28 01:25:57.392469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 76/169] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:57 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:57.453760 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:57.461830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f1cecd01-aa68-48cb-ae5b-712164b908af tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.183968 Jan 28 01:25:57.462421 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 94/170] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:57 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:58.063914 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:58.064515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:58.071193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.071541 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.072316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.072738 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.205845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:58.214187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2f48f861-e7dc-46e8-8122-fbc4f48c77bb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.153851 Jan 28 01:25:58.214927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 77/171] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:58 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:58.260103 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:58.260701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:58.267317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.267836 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.268610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.269029 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.405139 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:58.408014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:58.408639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:58.414538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:58.414736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.415149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.415926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.416063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:58.416347 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.417110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b5095648-d23d-467c-8122-db8aa2f0e7f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.160757 Jan 28 01:25:58.417891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 95/172] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:58 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:58.479192 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:58.479821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:58.486343 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.486794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.487681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:58.488118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:58.585206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:58.593098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5ece2227-71af-4d9b-b17d-7979aa3ffd6f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.188619 Jan 28 01:25:58.593712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 78/173] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:58 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:58.656622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:58.664345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-42071137-96ca-461e-88b3-8f6c504ac70a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.188887 Jan 28 01:25:58.664909 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 96/174] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:58 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:59.231871 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:59.232437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:59.238926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.239368 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.240151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.240577 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.387179 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:59.395218 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e0f7f7c4-3caa-4d5c-a810-8e9dac3c4852 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.167255 Jan 28 01:25:59.395806 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 79/175] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:59 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:25:59.435497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:59.436097 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:59.442387 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.442823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.443596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.444018 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.574892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:59.587385 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:59.588859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:59.590129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e60e5326-78cf-4d06-b088-1aac6c30b26f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.158460 Jan 28 01:25:59.590683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 97/176] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:25:59 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:25:59.614026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:59.614595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:59.621640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.622087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.623371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.623802 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.681516 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:25:59.682178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:25:59.688432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.688869 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.689682 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:25:59.690111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:25:59.879703 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:25:59.895042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ce6527d9-e0d6-4f66-8f67-6922e191a29d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1322 microversion: 2.1 time: 0.284292 Jan 28 01:25:59.896089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 80/177] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:59 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:25:59.985914 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:00.000592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f45bc815-a1b1-4915-8c7f-a9041c4f8309 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.322249 Jan 28 01:26:00.001871 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 98/178] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:25:59 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:00.413945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:00.416162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:00.425858 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:00.427018 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:00.428242 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:00.428783 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:00.609355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:00.610220 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:00.621305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:00.622112 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:00.623655 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:00.624445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:00.632642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:00.647471 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-70fbc3d7-9205-40d4-8126-00b97ada93cb tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.238515 Jan 28 01:26:00.649119 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 81/179] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:00 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:00.821684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:00.837176 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:00.838757 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:00.840397 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-64c514c6-8684-41d9-b3ef-3c7bccf993df tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.235553 Jan 28 01:26:00.840921 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 99/180] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:26:00 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:26:00.925345 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:00.926172 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:00.933734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:00.934309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:00.935282 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:00.935805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.030054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:01.031427 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:01.039040 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.040172 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.041622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.042211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.147940 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:01.160140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e379b65a-116f-49ec-a2f5-7f3eb96291c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1516 microversion: 2.1 time: 0.238449 Jan 28 01:26:01.161020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 82/181] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:00 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:01.194632 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:01.198654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:01.212130 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.213147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.214807 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.215823 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.303375 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lazy-loading 'flavor' on Instance uuid 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:26:01.350802 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:01.362402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a8870acd-7ad4-48f7-8c6c-6a4a487be8c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1318 microversion: 2.1 time: 0.338772 Jan 28 01:26:01.377389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 100/182] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:01 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:01.451647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3a527992-3fed-4238-b36b-48dd2b9dbc83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae/action" status: 200 len: 32 microversion: 2.1 time: 0.263606 Jan 28 01:26:01.458866 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 83/183] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:26:01 2022] POST /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae/action => generated 32 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:26:01.473832 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:01.474944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:01.486887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.488245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.489718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.490698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.672355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:01.673527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:01.683294 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.683734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.685338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.686158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.720692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:01.739111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fae50b38-e100-4a68-b726-89e67f5341b2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.271054 Jan 28 01:26:01.739111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 101/184] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:01 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:01.872930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:01.873611 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:01.886837 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.887878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.889824 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:01.890470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:01.910703 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:01.927674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b6b2099b-e8ec-413d-833c-0f8c0ed591c0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1315 microversion: 2.1 time: 0.260123 Jan 28 01:26:01.930921 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 84/185] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:01 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:02.185513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:02.200859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:02.203836 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:02.205993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3e90e03d-0680-43b1-a37a-35b8293015ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1405 microversion: 2.20 time: 0.341409 Jan 28 01:26:02.206994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 102/186] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:26:01 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1405 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:26:02.392420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:02.393993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:02.405343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:02.406726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:02.409307 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:02.412496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:02.767840 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:02.769125 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:02.781902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:02.783020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:02.784692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:02.785690 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:02.958126 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:02.980778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c8212039-cbaf-4ec0-93a3-bb6a4626b8bf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1505 microversion: 2.1 time: 0.595125 Jan 28 01:26:02.995998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 85/187] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:02 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1505 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:03.004426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:03.006050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:03.018776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:03.019825 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:03.021535 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:03.022583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:03.396150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:03.409603 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7a92adfe-a36a-4f29-b3a1-936dc0be182f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.649351 Jan 28 01:26:03.411026 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 103/188] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:02 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:03.424501 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:03.426092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:03.439481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:03.440982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:03.443855 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:03.445891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:04.159536 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:04.173165 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-928ebcde-cc9c-4216-9c44-0eeb3923ecda tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1501 microversion: 2.1 time: 1.175278 Jan 28 01:26:04.174449 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 86/189] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:02 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1501 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:04.298061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:04.320490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:04.326831 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:04.329991 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c236d7c6-c4fc-42ce-b159-588191c84628 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1596 microversion: 2.20 time: 0.915738 Jan 28 01:26:04.332155 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 104/190] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:26:03 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1596 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:26:04.363482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:04.364362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:04.377443 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:04.378600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:04.380659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:04.381724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:04.439602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:04.442288 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:04.466675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:04.468675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:04.470242 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:04.473029 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:05.184497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1aed18bc-3e59-4ac1-b921-f9294c8e1a5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.824906 Jan 28 01:26:05.185533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 87/191] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Jan 28 01:26:04 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-interface => generated 284 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:26:05.212884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d24609fe-3a6c-406d-b72e-70f946d0e4e6"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:05.217041 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:05.236103 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:05.236877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:05.238338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:05.239355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:05.517161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:05.547686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-181ad532-06b6-41a7-9dc3-489cd7617521 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 1.114473 Jan 28 01:26:05.549651 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 105/192] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:04 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:05.973341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be7076f1-2e22-482a-b13a-63c8866bdafb"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:05.998425 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:06.013774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:06.014273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:06.014913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:06.016729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:06.108735 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-95af56b4-b4ac-4911-97ad-775877350d4c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.905826 Jan 28 01:26:06.113663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 88/193] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:26:05 2022] POST /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments => generated 194 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:06.596589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:06.597911 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:06.616470 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:06.619435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:06.630040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:06.630888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:07.084356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:07.120291 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6c3d82ec-a375-44fc-9036-924f79d68a0b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.557328 Jan 28 01:26:07.121469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 89/194] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:06 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:07.813169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31cbd4a9-9b3d-4d8a-8d45-90683446f042 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "POST /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.859895 Jan 28 01:26:07.816555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 106/195] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:26:05 2022] POST /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734/os-volume_attachments => generated 194 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:26:08.149061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:08.150903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:08.167992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:08.168442 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:08.169283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:08.169747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:08.248605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:08.252009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:08.269632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:08.270321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:08.271720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:08.272393 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:08.460254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:08.462928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4259dffc-e197-4f64-b890-c3eac8e4b0ec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.226036 Jan 28 01:26:08.463997 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 107/196] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:08 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:08.471531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-196cdf73-1c0c-40f6-812c-9619ac079528 req-00c2a1df-a2e3-4a57-926c-6c3db6a79c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:08.473305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:26:08.473305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:26:08.475719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b580cc6d-3bd3-4cc3-9888-74a9767df545 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.330350 Jan 28 01:26:08.476532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 90/197] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:08 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:08.497970 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-196cdf73-1c0c-40f6-812c-9619ac079528 req-00c2a1df-a2e3-4a57-926c-6c3db6a79c8b service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:08.502048 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-196cdf73-1c0c-40f6-812c-9619ac079528 req-00c2a1df-a2e3-4a57-926c-6c3db6a79c8b service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:08.517091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-196cdf73-1c0c-40f6-812c-9619ac079528 req-00c2a1df-a2e3-4a57-926c-6c3db6a79c8b service nova] Creating event network-changed:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:26:08.528311 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-196cdf73-1c0c-40f6-812c-9619ac079528 req-00c2a1df-a2e3-4a57-926c-6c3db6a79c8b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059183 Jan 28 01:26:08.530344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 108/198] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:26:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:09.481629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:09.483542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:09.499994 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:09.500801 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:09.502895 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:09.503642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:09.503856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:09.504009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:09.515427 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:09.518782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:09.521670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:09.522947 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:09.744739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e78a4b5f-1464-431e-bc1f-28d3b5daca49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.270765 Jan 28 01:26:09.750299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 91/199] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:09 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:09.809105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:09.828152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-306efbcb-44fe-4375-970d-0facd7a64e03 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.328823 Jan 28 01:26:09.843277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 109/200] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:09 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:10.765705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:10.771385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:10.785419 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:10.786583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:10.788281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:10.789187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:10.851766 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:10.852508 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:10.860049 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:10.860484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:10.861330 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:10.861749 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:11.041450 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:11.050070 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31be925a-396f-41c3-a7a7-301ba90b7846 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.201916 Jan 28 01:26:11.050801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 110/201] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:10 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:12.074808 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:12.075748 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:12.082580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:12.083397 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:12.084305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:12.084988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:12.237963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:12.245761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-485d2ae8-d76b-44be-a1a5-b18d04a08854 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.174806 Jan 28 01:26:12.246347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 111/202] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:12 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:13.123507 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-27916df4-109b-43f5-b956-4db24f2630be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 2.367420 Jan 28 01:26:13.124316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 92/203] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:10 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:13.265904 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:13.266694 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:13.273291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:13.273737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:13.274550 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:13.274983 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:13.475713 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:13.484291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-776abf72-832d-47a0-8652-577c9c616d2f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.222913 Jan 28 01:26:13.484921 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 112/204] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:13 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:14.140513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:14.142211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:14.157321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:14.158521 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:14.160044 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:14.160965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:14.303253 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fdd8f01f-8bd2-455a-ad59-39082926efc9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.164164 Jan 28 01:26:14.303253 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 93/205] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:14 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:14.502152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:14.503045 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:14.509424 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:14.509863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:14.510634 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:14.511100 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:14.719513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:14.733475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-10cbad93-8f60-4c44-a27d-e5676bd33c47 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.234621 Jan 28 01:26:14.734632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 113/206] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:14 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:15.320255 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:15.322183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:15.335015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:15.335542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:15.336804 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:15.337628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:15.512913 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-65738c3f-765c-4de7-8253-ce88e7605641 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.199846 Jan 28 01:26:15.514271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 94/207] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:15 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:15.762353 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:15.767793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:15.779737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:15.780449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:15.781786 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:15.782494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:16.012437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:16.025144 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-14cea31e-a628-440c-a9c0-a7c38d8fa5e2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.269488 Jan 28 01:26:16.026150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 114/208] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:15 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:16.530993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:16.532760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:16.542456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:16.542895 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:16.543913 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:16.544091 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:16.857874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e72a59fe-d11a-4ca8-87d8-81c50bd2ee2b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.334143 Jan 28 01:26:16.860502 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 95/209] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:16 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:17.054238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:17.055191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:17.065626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:17.066288 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:17.067651 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:17.068392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:17.287197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:17.302217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-828a1acf-0c45-4eba-8999-1c71ed863644 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.253657 Jan 28 01:26:17.315003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 115/210] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:17 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:17.874053 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:17.880141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:17.898085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:17.898794 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:17.899696 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:17.900338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:18.093727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0e277819-c61b-44b5-84db-0e85533b9441 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.223781 Jan 28 01:26:18.095811 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 96/211] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:17 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:18.282034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1574324174", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "b39f7a55-675b-4821-a61a-a2d88e3cacd5"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:18.327655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:18.329526 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:18.344788 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:18.345972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:18.347390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:18.348123 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:18.385615 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] validate_networks() for [('b39f7a55-675b-4821-a61a-a2d88e3cacd5', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:26:18.686458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:18.699434 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0e12f2d5-ac19-4b75-8453-b942c42a59cd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.377597 Jan 28 01:26:18.700385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 97/212] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:18 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:18.997990 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:26:18.999667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:26:19.011174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:26:19.012130 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:26:19.012835 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:26:19.027028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:19.027781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:19.029054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:19.029884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:19.061684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:26:19.071055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for user bdd86efb97ad48a994f04304a8459e54 and project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:26:19.092793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:26:19.097206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:26:19.112134 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:19.114668 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:19.127011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:19.127715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:19.128700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:19.130320 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:19.169934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ecd59214-7b7b-4b37-9e45-c07e234949c2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893854 Jan 28 01:26:19.170897 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 116/213] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:26:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:26:19.190237 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-22743014-ef2d-42d2-a01a-fac5a71f0fe3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:19.191820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-22743014-ef2d-42d2-a01a-fac5a71f0fe3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:19.283252 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-22743014-ef2d-42d2-a01a-fac5a71f0fe3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:19.290996 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-22743014-ef2d-42d2-a01a-fac5a71f0fe3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1218 microversion: 2.1 time: 0.110563 Jan 28 01:26:19.291596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 117/214] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:19 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:19.328227 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5c7f694a-04d1-41f1-a942-1f0489e14bc6 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.223849 Jan 28 01:26:19.330692 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 98/215] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:19 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:19.732238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:19.735531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:19.756362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:19.757003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:19.757878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:19.758308 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:20.019287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:20.030107 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-22d39a7c-2e28-4d00-bb6e-3c04fc57ffb4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.308197 Jan 28 01:26:20.031245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 118/216] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:19 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:20.319279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:20.321450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:20.333892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:20.342813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:20.344394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:20.348336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:20.352058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:20.352609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:20.354271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:20.357375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:20.359392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:20.359909 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:20.526982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:20.541700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c71a5359-f9db-4455-b6dd-76180c9fff66 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1270 microversion: 2.1 time: 0.227866 Jan 28 01:26:20.557332 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 99/217] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:20 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1270 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:20.560192 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e345bd30-cd41-4819-8fd8-cec52b4da471 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.221550 Jan 28 01:26:20.562396 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 119/218] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:20 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:21.060261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:21.064136 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:21.072918 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:21.074852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:21.075996 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:21.076617 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:21.509032 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:21.521961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3b6068e4-98d0-46d3-a004-8fab079e5e60 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.470726 Jan 28 01:26:21.523359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 100/219] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:21 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:21.573800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:21.576492 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:21.578021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:21.581361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:21.597751 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:21.598541 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:21.599580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:21.600202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:21.600811 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:21.602762 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:21.606824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:21.613759 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:21.789423 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:21.804374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-70531f3b-e2f1-4cf7-a0e9-996bd57ac5e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1276 microversion: 2.1 time: 0.243355 Jan 28 01:26:21.806232 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 120/220] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:21 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1276 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:21.829627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4979c54e-ba45-4ec0-a348-80445b3d0e42 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.256742 Jan 28 01:26:21.831757 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 101/221] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:21 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:22.551701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:22.553507 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:22.562054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:22.562612 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:22.563705 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:22.564248 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:22.831765 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:22.834538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:22.847455 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:22.848318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:22.849398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:22.849748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:23.293556 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:23.316299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5b70c73a-6819-4852-adca-242b1a6ae62f tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.773124 Jan 28 01:26:23.329270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 121/222] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:22 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:23.329270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:23.329793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:23.343526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:23.344327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:23.345976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:23.346763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:23.498710 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:23.519695 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a580f827-0300-4454-8f25-d41783fe72c6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.695676 Jan 28 01:26:23.544127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 102/223] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:22 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:23.551414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d7102215-2e88-4858-9090-b6823e16db3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14 microversion: 2.20 time: 0.231246 Jan 28 01:26:23.552540 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 122/224] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:23 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:24.109205 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-c927ab07-4922-4e54-921d-37ec859b15ab req-f3c49d95-50ba-4f79-8d1d-6f5de9a1f91a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53f0c6ea-cf1e-4f40-a1df-34e3af551c5b", "tag": "0e97ac21-e6bf-4b16-a3c8-ceaa8e7b4c55"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:24.112646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:26:24.112646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:26:24.126219 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-c927ab07-4922-4e54-921d-37ec859b15ab req-f3c49d95-50ba-4f79-8d1d-6f5de9a1f91a service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.127365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-c927ab07-4922-4e54-921d-37ec859b15ab req-f3c49d95-50ba-4f79-8d1d-6f5de9a1f91a service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.146963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-c927ab07-4922-4e54-921d-37ec859b15ab req-f3c49d95-50ba-4f79-8d1d-6f5de9a1f91a service nova] Creating event network-changed:0e97ac21-e6bf-4b16-a3c8-ceaa8e7b4c55 for instance 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b on hv-cinder-82662 Jan 28 01:26:24.157513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-c927ab07-4922-4e54-921d-37ec859b15ab req-f3c49d95-50ba-4f79-8d1d-6f5de9a1f91a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052698 Jan 28 01:26:24.159054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 103/225] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:26:24.346938 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:24.347778 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:24.358155 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.358910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.360316 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.361287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.548260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:24.548852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:24.559749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.560458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.561852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.562505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.850945 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:24.870950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-28f48c4e-bacc-40b8-a5b7-4fe60d11916d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.528521 Jan 28 01:26:24.871897 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 123/226] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:24 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:24.894044 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:24.895654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:24.913656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.914847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.916546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:24.917677 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:24.973904 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:24.983649 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bb241570-23ba-4791-900e-d5d5169893ce tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.439581 Jan 28 01:26:24.993314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 104/227] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:24 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:25.133330 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-21603a8e-eb1f-4483-ac3f-4143a46bbf8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 6451 microversion: 2.20 time: 0.252587 Jan 28 01:26:25.133998 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 124/228] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:24 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 6451 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:26:25.911606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:25.913831 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:25.914413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:25.915627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:25.928234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:25.929010 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:25.930557 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:25.931318 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:25.942749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:25.943365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:25.944264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:25.944773 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:25.983599 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:26:26.130269 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6e7218d8-d25b-44d2-b09c-4f6db8518dd7 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 204 len: 0 microversion: 2.1 time: 0.216274 Jan 28 01:26:26.131546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 125/229] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:26:25 2022] DELETE /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:26:26.137980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:26.138692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:26.146319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:26.147111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:26.148110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:26.148586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:26.291632 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:26.303741 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-290494ee-fb46-475e-9314-26efefd8b28e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.405787 Jan 28 01:26:26.304804 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 105/230] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:25 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:26.310465 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:26.311442 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:26.319790 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:26.320693 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:26.321837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:26.322568 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:26.443400 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:26.457328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-575d7f58-5408-499a-a865-bdeeb51374e6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.323755 Jan 28 01:26:26.459390 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 126/231] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:26 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:26.474050 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:26.475912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:26.486786 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:26.487238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:26.488041 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:26.488484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:26.562385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:26.581102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f5fd56b5-6e44-4562-9e1e-a78b439c931d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.274631 Jan 28 01:26:26.582351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 106/232] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:26 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:26.697125 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bc7f0fec-07cf-4c6e-a468-c4515f87725d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 8637 microversion: 2.20 time: 0.235387 Jan 28 01:26:26.701976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 127/233] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:26 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 8637 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:26:27.325159 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:27.325959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:27.333274 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.333712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.334537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.334978 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.480398 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:27.481310 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:27.489899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.490555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.491653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.492316 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.558714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:27.572025 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b724ba97-568e-4e1a-b559-324c29182fbc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.251408 Jan 28 01:26:27.574138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 107/234] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:27 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:27.608368 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:27.610887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:27.623657 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.625200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.634468 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.635769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.840219 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:27.854786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-98823ecb-c0a2-4c9a-8e64-b0c8d2c4feac tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.250043 Jan 28 01:26:27.856008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 108/235] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:27 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:27.862589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:27.863816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:27.873515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.874216 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.875505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:27.876212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:27.906471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:27.922074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0e0ef548-34e9-41d2-98c9-787a45fdd0d6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.444963 Jan 28 01:26:27.928670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 128/236] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:27 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:28.090172 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-074ed658-0f3d-4251-80cd-c1ebb43e89e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 11371 microversion: 2.20 time: 0.231952 Jan 28 01:26:28.091145 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 109/237] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:27 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 11371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:28.601809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:28.602536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:28.613306 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:28.614537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:28.616229 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:28.617009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:28.837216 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:28.846160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0e5f7619-e471-426e-9e55-dfe4c1adc58e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.250641 Jan 28 01:26:28.854554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 129/238] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:28 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:28.884685 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:28.886469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:28.898485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:28.899411 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:28.900674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:28.901387 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:28.943208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:28.943661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:28.956951 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:28.957624 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:28.958931 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:28.959377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:29.219586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:29.225784 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:29.233193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d9da3ca1-3461-4140-82d5-1a35cbf94641 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.356423 Jan 28 01:26:29.233822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 110/239] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:28 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:29.243270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-062db08a-608b-449a-909d-dffb01008ce2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.302065 Jan 28 01:26:29.243270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 130/240] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:28 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:29.249107 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:29.253135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:29.261148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:29.261561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:29.262363 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:29.262799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:29.422621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-95d630d2-7a6d-4202-b093-3b96534309d8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 14250 microversion: 2.20 time: 0.181422 Jan 28 01:26:29.423481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 131/241] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:29 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 14250 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:29.865033 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:29.865748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:29.872942 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:29.873447 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:29.874263 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:29.874702 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:30.041574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:30.053282 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0cb52c83-73df-42cb-ac71-d9e6f24723fd tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.192420 Jan 28 01:26:30.054198 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 111/242] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:29 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:30.251838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:30.253517 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:30.258695 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:30.259570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:30.261760 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:30.262257 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:30.263089 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:30.263530 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:30.267589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:30.268469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:30.269200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:30.269944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:30.511170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:30.517529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:30.524339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9efe2737-1fe1-42f8-a1c2-3cb44c1f7b4d tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.276378 Jan 28 01:26:30.525303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 132/243] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:30 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:30.529981 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3df29bdd-ed7e-4cf4-8a24-28adf50c1ab2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.276001 Jan 28 01:26:30.530905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 112/244] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:30 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:30.540180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:30.540180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:30.544801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:30.545608 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:30.547098 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:30.547876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.071712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:31.072292 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:31.079848 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:31.080364 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.081178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:31.081655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.268865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:31.276974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ecde9184-c729-424c-bc83-78e3083b98a1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.209056 Jan 28 01:26:31.277797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 113/245] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:31 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:31.545610 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:31.546353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:31.553533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:31.553987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.554818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:31.555263 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.719553 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:31.731033 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ffe0ecfe-e4c1-4b31-8f47-c0f8a5eeded0 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.191407 Jan 28 01:26:31.731617 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 114/246] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:31 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:31.735984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:31.736589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:31.743184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:31.743628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.744425 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:31.744857 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:31.906916 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:31.919444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-467676aa-652d-4edc-9095-860567d8e5eb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.186624 Jan 28 01:26:31.920634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 115/247] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:31 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:32.298484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:32.299814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:32.309319 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:32.309938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:32.311174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:32.311861 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:32.469485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:32.480963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fae4a343-a3f0-4b26-b980-78e8c5751b6c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.188865 Jan 28 01:26:32.481589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 116/248] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:32 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:32.691308 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4c74c140-20e0-49ab-84d1-35364e3221be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 17629 microversion: 2.20 time: 2.163597 Jan 28 01:26:32.693025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 133/249] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:30 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 17629 bytes in 2167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:32.751657 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:32.752392 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:32.759667 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:32.760193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:32.761262 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:32.761822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:32.937516 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:32.946185 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:32.947790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:32.951409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c0383bab-55cf-48f7-a4f4-020aaa0f996e tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.203195 Jan 28 01:26:32.952457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 117/250] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:32 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:32.960068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:32.960838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:32.962481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:32.963245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:33.162607 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:33.177509 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5b721661-29b6-43d0-b21e-c7a543d02349 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.238630 Jan 28 01:26:33.178876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 134/251] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:32 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:33.502181 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:33.504053 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:33.513389 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:33.514328 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:33.515394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:33.516029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:33.711842 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:33.720221 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:33.740533 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:33.741814 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:33.744004 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:33.745600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:33.903934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:33.924164 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3e6ab853-f1d6-4251-99c7-5dae749a0a0a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.428119 Jan 28 01:26:33.925874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 118/252] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:33 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:33.978028 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:33.978657 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:33.987064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-eb64d362-ad0f-410a-a840-d03dd854f129 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 17808 microversion: 2.20 time: 0.284578 Jan 28 01:26:33.989336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:33.989561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 135/253] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:33 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 17808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:33.989822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:33.992327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:33.993574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:34.210356 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:34.211587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:34.219310 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:34.219754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:34.220543 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:34.220974 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:34.303778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:34.314432 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-32fcd5c7-1221-445d-9919-1b4edafc26da tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1553 microversion: 2.1 time: 0.342877 Jan 28 01:26:34.315313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 119/254] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:33 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:34.546548 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:34.554799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-91dd2e4e-c69c-4342-9795-9d90fb33094a tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.354156 Jan 28 01:26:34.555634 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 136/255] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:34 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:34.901027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-b0278935-8206-4e63-90c8-7aa3a5fd904d req-e09dd90e-047a-47f0-bca5-5230e27f5bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f0c6ea-cf1e-4f40-a1df-34e3af551c5b", "name": "network-vif-plugged", "status": "completed", "tag": "0e97ac21-e6bf-4b16-a3c8-ceaa8e7b4c55"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:34.905709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:26:34.905709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:26:34.922006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-b0278935-8206-4e63-90c8-7aa3a5fd904d req-e09dd90e-047a-47f0-bca5-5230e27f5bb5 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:34.923197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-b0278935-8206-4e63-90c8-7aa3a5fd904d req-e09dd90e-047a-47f0-bca5-5230e27f5bb5 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:34.947444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-b0278935-8206-4e63-90c8-7aa3a5fd904d req-e09dd90e-047a-47f0-bca5-5230e27f5bb5 service nova] Creating event network-vif-plugged:0e97ac21-e6bf-4b16-a3c8-ceaa8e7b4c55 for instance 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b on hv-cinder-82662 Jan 28 01:26:34.950231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:34.952454 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:34.955135 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-b0278935-8206-4e63-90c8-7aa3a5fd904d req-e09dd90e-047a-47f0-bca5-5230e27f5bb5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063072 Jan 28 01:26:34.956414 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 120/256] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:34.963961 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:34.964668 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:34.973018 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:34.973018 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.006848 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:35.012385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:35.051139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.051675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.052806 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.053369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.295830 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-be98bc7a-bd9a-4035-b989-f7dd85f40edd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 19342 microversion: 2.20 time: 0.296641 Jan 28 01:26:35.298018 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 121/257] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:34 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 19342 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:35.316193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-3a24d5a0-82a3-49b7-b828-c5507c0d56c9 req-3c597117-86fd-458b-8d53-6d099897c787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fb90ad9-31f4-41d7-968a-3a0b4d183734", "name": "network-vif-deleted", "tag": "8aa5043e-3152-48fe-a672-71b585f0fe26"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:35.319048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:26:35.319048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:26:35.339756 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-3a24d5a0-82a3-49b7-b828-c5507c0d56c9 req-3c597117-86fd-458b-8d53-6d099897c787 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.340022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-3a24d5a0-82a3-49b7-b828-c5507c0d56c9 req-3c597117-86fd-458b-8d53-6d099897c787 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.366257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-3a24d5a0-82a3-49b7-b828-c5507c0d56c9 req-3c597117-86fd-458b-8d53-6d099897c787 service nova] Creating event network-vif-deleted:8aa5043e-3152-48fe-a672-71b585f0fe26 for instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 on hv-cinder-82662 Jan 28 01:26:35.378154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-3a24d5a0-82a3-49b7-b828-c5507c0d56c9 req-3c597117-86fd-458b-8d53-6d099897c787 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076574 Jan 28 01:26:35.379517 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 122/258] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:35.390204 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:35.391121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:35.404039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:35.404855 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.405694 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.408539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.408539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.423214 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-025907ca-26d1-4d50-a050-d857f5145542 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.480021 Jan 28 01:26:35.437830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 137/259] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:34 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:35.530782 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:35.546211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-36c89ddb-b066-4d56-8a8f-6d7a5ca756df tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1346 microversion: 2.1 time: 0.163922 Jan 28 01:26:35.547481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 123/260] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:35 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1346 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:35.580549 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:35.581157 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:35.595827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.596682 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.598253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:35.599087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:35.848875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:35.858428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b560abd3-17f1-46ae-a03f-7653a15e1581 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.281282 Jan 28 01:26:35.859311 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 138/261] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:35 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:36.326067 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:36.327008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:36.333835 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.334285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.335085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.335507 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.455193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:36.457402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:36.465934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.466670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.468278 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.468943 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.525492 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-57b67ad1-92f8-411f-9148-e23d60293295 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 21059 microversion: 2.20 time: 0.206453 Jan 28 01:26:36.527377 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 124/262] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:36 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 21059 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:36.569467 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:36.571645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:36.586661 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.588169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.589727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.590672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.678299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.679654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.680300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lazy-loading 'fault' on Instance uuid 1fb90ad9-31f4-41d7-968a-3a0b4d183734 {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:26:36.743250 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:36.755060 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fc4e2dbf-2905-4019-ad88-425c692014a9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.309356 Jan 28 01:26:36.756017 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 139/263] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:36 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:36.772834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ee6fde063b34646b4ca6d477f389002', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e75918ca77e4370a5219466a06ca9a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:36.783277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-61066256-76ce-4a24-b84d-47ce091afe62 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 200 len: 1351 microversion: 2.1 time: 0.221419 Jan 28 01:26:36.783870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 125/264] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:36 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 1351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:36.891244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:36.893422 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:36.919021 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.920268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:36.922069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:36.923118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.164113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:37.177411 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5824d35b-b658-4401-a57d-e96e8e7558c7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1318 microversion: 2.1 time: 0.296091 Jan 28 01:26:37.178847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 140/265] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:36 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:37.544009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:37.546733 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:37.562663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:37.563471 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.565566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:37.566379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.769363 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-770e4170-5de8-4aff-8ae4-3921f2f5cc49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 21930 microversion: 2.20 time: 0.231447 Jan 28 01:26:37.776442 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 126/266] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:37 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 21930 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:37.782973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:37.784112 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:37.797532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:37.798339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.799717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:37.800632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.813390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:37.818425 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:37.829722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:37.831391 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.833735 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:37.835206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:37.857182 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] HTTP exception thrown: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. Jan 28 01:26:37.858133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Returning 404 to user: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:26:37.859331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-411442ee-6bb2-4039-a499-7656b210ead8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 404 len: 111 microversion: 2.1 time: 0.053913 Jan 28 01:26:37.860091 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 127/267] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:37 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:26:38.019437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:38.033260 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d0c69890-0e5d-4814-be52-33a055d19500 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.255924 Jan 28 01:26:38.042952 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:38.044469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 141/268] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:37 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:38.045711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:38.056408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.057050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.058388 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.059621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.082991 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] HTTP exception thrown: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. Jan 28 01:26:38.084369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Returning 404 to user: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:26:38.086324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cfb4e4e0-cdff-4d27-a98e-2936d761707b tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053083 Jan 28 01:26:38.087680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 128/269] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:26:38 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:26:38.199302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:38.201151 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:38.214927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.215626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.217244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.218303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.524069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:38.532346 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bf00b2d0-47f9-4005-98d7-fd6dc338f088 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1505 microversion: 2.1 time: 0.339406 Jan 28 01:26:38.532929 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 142/270] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:38 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:38.554361 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d24609fe-3a6c-406d-b72e-70f946d0e4e6"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:38.556313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:38.567258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.568679 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.570127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.570870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.681924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] HTTP exception thrown: Invalid volume: volume d24609fe-3a6c-406d-b72e-70f946d0e4e6 is already attached to instances: 92a6de0f-2d0d-4667-aa75-cdfa602b2385 Jan 28 01:26:38.682851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Returning 400 to user: Invalid volume: volume d24609fe-3a6c-406d-b72e-70f946d0e4e6 is already attached to instances: 92a6de0f-2d0d-4667-aa75-cdfa602b2385 {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:26:38.683867 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f04872ce-8b4b-45d6-b485-b76190cce731 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.136554 Jan 28 01:26:38.684450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 129/271] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:26:38 2022] POST /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:26:38.755483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:38.756097 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:38.762477 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.762927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.763722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.764156 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.787343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:38.788642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:38.799951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.800945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.802329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:38.803047 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:38.929013 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lazy-loading 'services' on Instance uuid 92a6de0f-2d0d-4667-aa75-cdfa602b2385 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:26:38.986789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-70530fba-d5da-492c-b84f-5515ec11d190 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 22710 microversion: 2.20 time: 0.205500 Jan 28 01:26:38.987457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 130/272] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:38 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 22710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:39.058540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:39.059235 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:39.066684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.067131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.067939 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.068365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.200725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8c5d4815-57d3-4b4a-bd24-8dc86ab19ccd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments/d24609fe-3a6c-406d-b72e-70f946d0e4e6" status: 202 len: 0 microversion: 2.1 time: 0.448682 Jan 28 01:26:39.201996 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 143/273] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:26:38 2022] DELETE /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments/d24609fe-3a6c-406d-b72e-70f946d0e4e6 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:39.221359 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:39.224761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:39.235317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.236578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.238547 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.239988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.299284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d0c6e5a5-7fd1-473f-b5ac-34f6d9df8292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088921 Jan 28 01:26:39.300327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 144/274] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:26:39 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:39.327922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:39.337103 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a8d07bc3-5a80-4fd7-9a34-75e20279c797 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.282670 Jan 28 01:26:39.338069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 131/275] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:39 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:39.470265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:39.471135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:39.480573 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.481373 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.482698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.483492 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.510199 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] HTTP exception thrown: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. Jan 28 01:26:39.511030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Returning 404 to user: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:26:39.512154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-81a1d3dd-0fd5-4a0d-9ed2-e97352176bf8 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 404 len: 111 microversion: 2.1 time: 0.051524 Jan 28 01:26:39.512727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 145/276] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:26:39 2022] DELETE /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:26:39.524506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:39.525532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] [instance: 1fb90ad9-31f4-41d7-968a-3a0b4d183734] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:39.535814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.538127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.539493 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:39.540285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:39.563452 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] HTTP exception thrown: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. Jan 28 01:26:39.564360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] Returning 404 to user: Instance 1fb90ad9-31f4-41d7-968a-3a0b4d183734 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:26:39.565544 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-50129775-03e7-4a97-9e14-0c393e899381 tempest-DeleteServersTestJSON-579654442 tempest-DeleteServersTestJSON-579654442-project] 10.222.0.16 "GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734" status: 404 len: 111 microversion: 2.1 time: 0.046659 Jan 28 01:26:39.566327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 132/277] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:39 2022] GET /compute/v2.1/servers/1fb90ad9-31f4-41d7-968a-3a0b4d183734 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:26:40.007152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:40.009315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:40.022220 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:40.022876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:40.023903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:40.024500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:40.185053 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1d070feb-92ca-4931-98ab-2fb7f2905f5c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 23228 microversion: 2.20 time: 0.187902 Jan 28 01:26:40.189282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 146/278] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:39 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 23228 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:40.319234 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:40.322149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:40.333623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:40.334859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:40.336776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:40.337878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:40.365861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:40.369279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:40.386851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:40.388302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:40.389846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:40.390479 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:40.422046 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0fbd206f-5994-4b15-acb8-9cf00ab6270b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108399 Jan 28 01:26:40.423838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 133/279] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:26:40 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:40.771855 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:40.786253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0207a1d0-bcce-4a52-82e4-2f27bc1cc62b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.426357 Jan 28 01:26:40.788458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 147/280] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:40 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:41.201107 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:41.203100 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:41.211734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:41.212498 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:41.213619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:41.214267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:41.382528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1961e7f0-9d1c-49f3-ab36-be2900658e7f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 23797 microversion: 2.20 time: 0.185799 Jan 28 01:26:41.384652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 134/281] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:41 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 23797 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:41.439348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:41.440779 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:41.451350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:41.452465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:41.454104 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:41.455061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:41.518371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c5d26929-34a3-4c02-9d13-4d0a9c36cf87 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084657 Jan 28 01:26:41.519533 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 148/282] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:26:41 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:41.815225 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:41.816486 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:41.842641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:41.843087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:41.843899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:41.844319 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:42.059585 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:42.068826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6004fe66-a192-4caf-91ed-795f02ccb1ce tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.259320 Jan 28 01:26:42.069879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 135/283] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:41 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:42.400337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:42.402022 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:42.417928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:42.418712 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:42.420147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:42.420849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:42.537966 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:42.540539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:42.549673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:42.550354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:42.551668 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:42.552394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:42.589863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b152d3b5-3c75-41a5-96a5-3cd4282f8251 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 24335 microversion: 2.20 time: 0.194818 Jan 28 01:26:42.591413 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 149/284] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:42 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 24335 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:42.607772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f3de9856-0133-4ed0-a2c3-17ab86cc0ee8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077238 Jan 28 01:26:42.608819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 136/285] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:26:42 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:26:42.851337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-93596943", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "b39f7a55-675b-4821-a61a-a2d88e3cacd5"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:42.979576 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] validate_networks() for [('b39f7a55-675b-4821-a61a-a2d88e3cacd5', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:26:43.100737 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:43.102767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:43.134879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:43.135732 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:43.146441 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:43.149399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:43.540729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:43.549277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-075c4bf2-4fbc-420a-98b6-4e61f0a7a24c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.458200 Jan 28 01:26:43.549860 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 137/286] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:43 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:43.606311 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:43.607768 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:43.620119 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:43.621538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:43.633260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:43.634148 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:43.818524 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4df8367a-3ded-4e3a-9e93-ae410db00b5a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 24814 microversion: 2.20 time: 0.216430 Jan 28 01:26:43.820063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 138/287] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:43 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 24814 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:44.090596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:26:44.091799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:26:44.093507 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:26:44.094692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:26:44.095826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:26:44.108078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:44.111564 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:44.113329 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:44.114296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:44.139669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:26:44.146787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for user bdd86efb97ad48a994f04304a8459e54 and project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:26:44.172666 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:26:44.177485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:26:44.281474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-61e1c3f1-0e48-4505-b884-33b03ec8af4f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.437852 Jan 28 01:26:44.283461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 150/288] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1442 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:26:44.299230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-53fa3de8-c4ad-48ac-94f1-6bc620223514 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:44.300529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-53fa3de8-c4ad-48ac-94f1-6bc620223514 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:44.422929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-53fa3de8-c4ad-48ac-94f1-6bc620223514 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:44.429378 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-53fa3de8-c4ad-48ac-94f1-6bc620223514 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1216 microversion: 2.1 time: 0.136486 Jan 28 01:26:44.429996 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 139/289] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:44 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1216 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:44.573048 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:44.573774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:44.583906 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:44.584984 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:44.589095 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:44.592352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:44.837824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:44.838991 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:44.855968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:44.857830 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:44.859822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:44.862330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:45.019008 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:45.037593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-490b296d-de0e-407f-bdf3-af8d231fb778 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.468371 Jan 28 01:26:45.039866 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 151/290] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:44 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:45.064959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3ec397f3-b871-4c79-aac1-f54a589ab90c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 25459 microversion: 2.20 time: 0.233345 Jan 28 01:26:45.065940 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 140/291] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:44 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 25459 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:45.462299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:45.472732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:45.484243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:45.484988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:45.487108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:45.488172 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:45.648295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:45.668003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4665ff8e-b808-4ecc-b498-3c1c26b8f1e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1268 microversion: 2.1 time: 0.214275 Jan 28 01:26:45.684075 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 152/292] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:45 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1268 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:46.079440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:46.091492 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:46.092898 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:46.095012 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:46.112163 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:46.112938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:46.114385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:46.115101 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:46.117625 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:46.119032 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:46.123235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:46.124552 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:46.435580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-699831e4-2510-4a62-a9f0-3db4adc31b29 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 26362 microversion: 2.20 time: 0.358661 Jan 28 01:26:46.438034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 153/293] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:46 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 26362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:46.716455 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:46.718918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:46.755119 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:46.755987 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:46.757064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:46.758586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:46.783853 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:46.808814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dd830b94-7f2a-4a57-a139-fc68af31391a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.747781 Jan 28 01:26:46.814982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 141/294] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:46 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:46.928298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:46.951145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-45994aac-1dca-4596-b80b-2ddc5afe6fab tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1286 microversion: 2.1 time: 0.257734 Jan 28 01:26:46.954860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 154/295] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:46 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1286 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:47.452415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:47.453959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:47.479121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:47.479121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:47.479121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:47.479548 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:47.838146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:47.839006 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:47.855957 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:47.856445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:47.859196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:47.860081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:47.883766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5361c2f4-6fe7-48ec-9272-bd63902370db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 27049 microversion: 2.20 time: 0.437667 Jan 28 01:26:47.886272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 142/296] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:47 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 27049 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:47.984779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:47.987457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:48.025426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:48.027622 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:48.029696 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:48.033665 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:48.529142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:48.542969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6221bb7e-8e01-4fb1-997f-8040b7058eab tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.710878 Jan 28 01:26:48.559038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 155/297] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:47 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:48.583825 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:48.602102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1b69e2d5-ebb2-4947-bffb-640816fc42e1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.625206 Jan 28 01:26:48.605009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 143/298] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:47 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:48.907599 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:48.909929 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:48.926973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:48.928817 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:48.931948 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:48.934485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:49.166152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6a82542f-fcb0-4b52-8e1d-7335d83646f5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 27507 microversion: 2.20 time: 0.270188 Jan 28 01:26:49.168002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 156/299] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:48 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 27507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:49.570976 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:49.572798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:49.597646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:49.602157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:49.603567 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:49.604776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:49.635160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:49.635903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:49.656305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:49.657521 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:49.659767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:49.659767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:50.130558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:50.144224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-75b377fc-326c-47ff-8d06-995b9dd937d6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.583185 Jan 28 01:26:50.145638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 144/300] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:49 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:50.156596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-1e911f86-facb-4267-8234-2e156c64a586 req-3d3eecc7-2036-4210-8188-5ab0c4d86504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4", "tag": "340324e7-17ea-494c-be8f-764631958e2f"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:50.160008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:26:50.160008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:26:50.176016 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-1e911f86-facb-4267-8234-2e156c64a586 req-3d3eecc7-2036-4210-8188-5ab0c4d86504 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:50.176712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-1e911f86-facb-4267-8234-2e156c64a586 req-3d3eecc7-2036-4210-8188-5ab0c4d86504 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:50.193459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-1e911f86-facb-4267-8234-2e156c64a586 req-3d3eecc7-2036-4210-8188-5ab0c4d86504 service nova] Creating event network-changed:340324e7-17ea-494c-be8f-764631958e2f for instance 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 on hv-cinder-82662 Jan 28 01:26:50.199815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-1e911f86-facb-4267-8234-2e156c64a586 req-3d3eecc7-2036-4210-8188-5ab0c4d86504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052530 Jan 28 01:26:50.200745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 145/301] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:26:50.208601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:50.211301 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:50.221716 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:50.222459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:50.224815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:50.225570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:50.256665 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:50.279962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-18146534-9f0d-45ca-8f86-40ceb4f32820 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.644653 Jan 28 01:26:50.294524 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 157/302] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:49 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:50.439025 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-53d0a4d3-d2bf-4165-be53-11156824e0e1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 27804 microversion: 2.20 time: 0.233774 Jan 28 01:26:50.447675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 146/303] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:50 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 27804 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:51.171989 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:51.173483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:51.190327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:51.191971 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:51.195567 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:51.196737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:51.305826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:51.307258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:51.323257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:51.324379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:51.326563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:51.333804 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:51.473868 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:51.498557 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-38d7ef5e-b183-440f-a4ab-7322b8299683 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.333354 Jan 28 01:26:51.508905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 158/304] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:51 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:51.509491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:51.511255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:51.526084 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:51.526954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:51.528409 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:51.529354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:51.572348 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:51.589004 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-131bcf0d-1843-44c5-89d1-9a097fc48f38 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.291501 Jan 28 01:26:51.606230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 147/305] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:51 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:52.519595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:52.531595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:52.549595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:52.550577 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:52.552161 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:52.553359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:52.740097 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:52.748496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bb3a5405-410e-49f2-8f6a-83a1845fd46c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.235973 Jan 28 01:26:52.749523 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 148/306] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:52 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:52.753645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:52.754410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:52.767188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:52.767715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:52.768554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:52.768987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:52.948140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:52.957815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c4beaf61-e368-4d9d-b07c-7af6eedb86f3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.206642 Jan 28 01:26:52.958396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 149/307] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:52 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:53.770959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:53.772064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:53.783642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:53.784414 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:53.786074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:53.787086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:53.980420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:54.002547 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e64f9743-81ba-450c-be8d-229e04949da2 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1522 microversion: 2.1 time: 0.238104 Jan 28 01:26:54.017271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 150/308] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:53 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:54.029759 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:54.032661 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:54.042138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:54.042138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:54.043014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:54.043451 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:54.300364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5c61c8cd-c177-4393-9112-1c4b3cf7a415 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28160 microversion: 2.20 time: 2.797347 Jan 28 01:26:54.303384 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 159/309] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:51 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28160 bytes in 2802 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:54.381472 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:54.398582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c5914f1c-9d50-4c1b-ac7b-3ff814baed7c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.381839 Jan 28 01:26:54.400436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 151/310] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:54 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:55.036175 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:55.037660 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:55.051340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.052511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.054012 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.054788 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.318405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:55.320594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:55.328075 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.328512 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.329581 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.330011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.407947 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:55.421431 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-66c12f0f-1183-464b-9336-c3f6e1e6a534 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1502 microversion: 2.1 time: 0.393512 Jan 28 01:26:55.436797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 160/311] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:55 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1502 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:55.444561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:55.445672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:55.456842 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.458068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.459583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.460414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.525492 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a94629c6-3380-4282-927c-a50a76a83d65 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28460 microversion: 2.20 time: 0.210514 Jan 28 01:26:55.530985 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 152/312] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:55 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28460 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:26:55.541099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:55.543114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:55.556847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.557783 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.559811 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:55.561111 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:55.778242 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:55.796715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6b963601-a8d5-4e07-8883-67def7d89079 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.358405 Jan 28 01:26:55.798067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 161/313] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:55 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:55.902394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:55.916220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ab13943e-8e6f-4299-8d12-5940701a02d3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1515 microversion: 2.1 time: 0.384192 Jan 28 01:26:55.917505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 153/314] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:55 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1515 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:56.541827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:56.542862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:56.557142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:56.558138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:56.559120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:56.559724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:56.750422 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2002583e-a678-4b19-9e58-7051862f67ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28519 microversion: 2.20 time: 0.213952 Jan 28 01:26:56.752259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 162/315] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:56 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:26:56.824530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:56.825395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:56.835405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:56.836231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:56.837656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:56.840351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.048082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:57.058036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6e4f6299-4376-418b-8d60-3ff085af1299 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.238278 Jan 28 01:26:57.059122 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:56 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:57.633889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:57.636233 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:57.648009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:57.648546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.649445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:57.650106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.679888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lazy-loading 'flavor' on Instance uuid 96d2486b-d99e-4c1b-b15e-173a27da5960 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:26:57.766103 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:26:57.767019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:57.773687 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:57.774316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.775124 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:57.775557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.831401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-aa1032f7-59c2-4585-960d-4d9668c0c4bc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action" status: 200 len: 32 microversion: 2.1 time: 0.205947 Jan 28 01:26:57.831401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 163/317] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:26:57 2022] POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action => generated 32 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:26:57.835653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:57.836354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:57.843246 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:57.843697 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.844511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:57.844982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:57.986485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:57.996213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f983649d-e046-4421-8675-9de5f4db5cdc tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.164797 Jan 28 01:26:57.996824 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 164/318] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:57 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:58.078713 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:58.079280 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:58.086249 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:58.086696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:58.087480 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:58.087910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:58.235729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:58.247217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-601e4df1-dabe-4d05-b4e3-e5a997442ef5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.173336 Jan 28 01:26:58.248024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 165/319] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:58 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:26:59.014933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:59.015675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:59.022604 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:59.023065 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:59.023862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:59.024298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:59.159509 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:59.167415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6c8ddf89-7ea6-4891-aae9-b3aa276949c5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.156219 Jan 28 01:26:59.168101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 166/320] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:59 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:26:59.265676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:26:59.266317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:26:59.272947 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:59.273422 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:59.274218 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:26:59.274649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:26:59.422552 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:26:59.430490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9159d3db-e0ac-4272-af66-25707121fedb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.168570 Jan 28 01:26:59.431076 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 167/321] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:26:59 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:00.184737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:00.185481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:00.199290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:00.199790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:00.200586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:00.201007 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:00.368876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:00.377326 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-92c3a3d1-2714-4839-a7d6-1e44378a7820 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.196289 Jan 28 01:27:00.377923 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 168/322] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:00 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:00.430605 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-70097219-9510-47a9-bc16-8ea90b54e6ca tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28519 microversion: 2.20 time: 2.668060 Jan 28 01:27:00.432143 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 155/323] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:26:57 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28519 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:00.460813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:00.462083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:00.468644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:00.469108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:00.469951 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:00.470377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:00.826064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:00.838222 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bd92fb3b-b59a-4299-9fc2-5d7c8f900115 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.391955 Jan 28 01:27:00.839440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 169/324] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:00 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:01.400222 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:01.400878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:01.408208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:01.408637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:01.409462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:01.409876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:01.444114 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:01.445027 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:01.451845 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:01.452302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:01.453083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:01.453543 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:01.571529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:01.579551 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d022e634-fa9f-485e-8e3d-4ff8fe1a8ee1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.183402 Jan 28 01:27:01.580147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 156/325] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:01 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:01.859821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:01.860458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:01.867386 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:01.867833 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:01.868619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:01.869071 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:02.024403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:02.031721 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-75663869-18bf-4ae0-acdb-4c0b3bd3a426 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.175704 Jan 28 01:27:02.032280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 157/326] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:01 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:02.597693 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:02.598423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:02.614360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:02.614803 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:02.615597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:02.616029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:02.751832 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:02.760256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-02a6ec73-7e13-4b70-ad58-42fdebb1494b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.166617 Jan 28 01:27:02.760887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 158/327] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:02 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:03.048293 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:03.048993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:03.055186 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:03.055761 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:03.056574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:03.057162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:03.225845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:03.233797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-20b0f5c8-e3ae-4f55-b3fa-eca41c372494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.189511 Jan 28 01:27:03.234369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 159/328] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:03 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:03.782162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:03.783315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:03.795295 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:03.796034 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:03.797260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:03.797933 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:03.946787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-229b7abf-c057-4e8f-9fa7-97f4880b877f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28519 microversion: 2.20 time: 2.506140 Jan 28 01:27:03.948323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 170/329] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:01 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28519 bytes in 2509 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:04.050020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:04.065873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a557cc81-60cd-4cff-975c-e413ba8d8b86 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.289914 Jan 28 01:27:04.066805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 160/330] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:03 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:04.254568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:04.255645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:04.263283 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:04.263839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:04.264630 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:04.265058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:04.461966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:04.470960 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5d529017-fd2b-4831-8fb4-e1966388237f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.220403 Jan 28 01:27:04.471542 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 171/331] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:04 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:04.961631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:04.962639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:04.971182 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:04.971629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:04.972724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:04.973158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:05.089214 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:05.090161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:05.098019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:05.098391 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:05.099156 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:05.099586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:05.277978 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:05.288333 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3419a83c-ab53-4bfd-9e8e-9fcaa592449d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.203514 Jan 28 01:27:05.289148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 172/332] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:05 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:05.490160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:05.491004 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:05.501674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:05.502401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:05.503663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:05.504357 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:05.666854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:05.675137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-db613c84-4e94-45b2-9a79-6da817b59a37 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.190227 Jan 28 01:27:05.675780 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 173/333] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:05 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:06.306911 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:06.307606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:06.317340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:06.317340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:06.317340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:06.317340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:06.456396 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:06.464630 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d48860a1-5d01-49e0-afbb-c12f7fdb06db tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.161398 Jan 28 01:27:06.465416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 174/334] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:06 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:06.692622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:06.693341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:06.700367 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:06.700821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:06.701657 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:06.702118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:06.838638 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:06.846723 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-749c28d2-22de-4adb-a8b1-581a8e8313e5 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.157757 Jan 28 01:27:06.847298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 175/335] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:06 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:07.262949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b6859a11-6701-4113-92e5-8ab32752a518 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28519 microversion: 2.20 time: 2.306156 Jan 28 01:27:07.264081 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 161/336] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:04 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28519 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:07.482196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:07.483071 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:07.490048 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:07.490495 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:07.491314 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:07.491731 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:07.685043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:07.695451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2b0c84fa-4037-4199-99e6-16f4a8e6d6df tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.217012 Jan 28 01:27:07.696394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 176/337] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:07 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:07.864570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:07.865162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:07.873984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:07.874433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:07.875408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:07.875864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:08.045524 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:08.053444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dab08580-8f53-4972-94f0-556603c3a3cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.192960 Jan 28 01:27:08.054037 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 162/338] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:07 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:08.275963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:08.276937 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:08.285126 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:08.285626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:08.286731 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:08.287078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:08.462223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-db7bd9df-8e9d-40a6-a039-3c9dd6b0d307 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28519 microversion: 2.20 time: 0.190134 Jan 28 01:27:08.464444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 177/339] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:08 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:08.718339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:08.719271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:08.726467 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:08.726977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:08.727964 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:08.728418 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:08.953027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:08.964049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-24e2c3d3-18d8-4297-98a1-045099cb4ca5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.251159 Jan 28 01:27:08.972500 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 163/340] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:08 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:09.075839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:09.077067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:09.089639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:09.090411 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:09.091750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:09.092474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:09.287335 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:09.296194 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9d4ea03c-7399-4304-ad68-7f4995fcb027 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.227493 Jan 28 01:27:09.296857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 178/341] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:09 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:09.476836 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:09.477844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:09.484732 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:09.485144 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:09.485975 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:09.486407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:09.980522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:09.981038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:09.987907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:09.988360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:09.989168 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:09.989648 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:10.149895 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:10.160388 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-449272e4-0379-4dfc-818a-ea0a236f93b4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.183643 Jan 28 01:27:10.161334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 179/342] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:09 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:10.316774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:10.317325 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:10.324406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:10.324853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:10.325735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:10.326179 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:10.492572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:10.500727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-23091b8f-5dfe-4807-804a-e4531cbae3ba tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.187835 Jan 28 01:27:10.501339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 180/343] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:10 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:11.179145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:11.179922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:11.187973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:11.188567 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:11.189301 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:11.189808 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:11.382429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:11.390690 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3fa8c968-1498-4600-aa07-2e39915099a0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.215348 Jan 28 01:27:11.391297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 181/344] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:11 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:11.505110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-b7c79ce7-5dd2-4e3f-aecb-7479c8ebed5f req-15a92331-b578-4d17-a0a5-ec37187439a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4", "name": "network-vif-plugged", "status": "completed", "tag": "340324e7-17ea-494c-be8f-764631958e2f"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:11.506718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:27:11.506718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:27:11.513880 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-b7c79ce7-5dd2-4e3f-aecb-7479c8ebed5f req-15a92331-b578-4d17-a0a5-ec37187439a0 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:11.514316 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-b7c79ce7-5dd2-4e3f-aecb-7479c8ebed5f req-15a92331-b578-4d17-a0a5-ec37187439a0 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:11.526368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-b7c79ce7-5dd2-4e3f-aecb-7479c8ebed5f req-15a92331-b578-4d17-a0a5-ec37187439a0 service nova] Creating event network-vif-plugged:340324e7-17ea-494c-be8f-764631958e2f for instance 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 on hv-cinder-82662 Jan 28 01:27:11.531429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-b7c79ce7-5dd2-4e3f-aecb-7479c8ebed5f req-15a92331-b578-4d17-a0a5-ec37187439a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029912 Jan 28 01:27:11.532674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 182/345] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:27:11.538570 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:11.539375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:11.547757 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:11.548916 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:11.549293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:11.549777 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:11.721724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:11.729535 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-eedcd722-af3e-43ff-9773-e343a474cc18 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.196279 Jan 28 01:27:11.730109 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 183/346] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:11 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:12.384780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-734e2ca8-5600-43be-a59b-205fa7b80b99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 28809 microversion: 2.20 time: 2.911912 Jan 28 01:27:12.385848 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 164/347] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:09 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 28809 bytes in 2914 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:12.408067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:12.408846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:12.422515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:12.423325 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:12.424963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:12.425886 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:12.611945 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:12.624321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0bb9fb9f-c2c9-4b7b-9ecd-52b0c2631ab0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.219655 Jan 28 01:27:12.625650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 184/348] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:12 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:12.749272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:12.750051 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:12.757746 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:12.758313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:12.759259 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:12.759861 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:12.973997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:12.985697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9c76cef4-321c-4839-88fb-b1ada4219292 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.240474 Jan 28 01:27:12.986727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 165/349] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:12 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:13.399413 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:13.400475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:13.407188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:13.407646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:13.408691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:13.409466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:13.645614 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:13.646603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:13.657901 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:13.658676 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:13.659998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:13.660607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:13.809321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:13.819957 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bfa87392-985e-4a2b-813f-9f47295270ea tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.181347 Jan 28 01:27:13.820717 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 166/350] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:13 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:14.003559 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:14.004224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:14.018501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:14.019984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:14.021770 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:14.022215 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:14.185199 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:14.193129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-537519f2-9e61-4c51-a726-98b3e2b2e254 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.193424 Jan 28 01:27:14.193749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 167/351] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:13 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:14.849088 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:14.850268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:14.861374 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:14.862151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:14.863553 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:14.864386 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:15.001953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:15.009634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3886288a-20af-47b3-b83f-18c968f14252 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.167373 Jan 28 01:27:15.010217 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 168/352] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:14 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:15.213968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:15.214730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:15.221653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:15.222099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:15.223057 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:15.223486 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:15.373886 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:15.381691 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5f187619-8a46-4399-8103-b635b6e9781d tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.171571 Jan 28 01:27:15.382272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 169/353] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:15 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:15.944850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-41f4f59a-510d-4f91-aba4-b5c36f7b367f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29114 microversion: 2.20 time: 2.549725 Jan 28 01:27:15.945851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 185/354] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:13 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29114 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:16.026929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:16.027692 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:16.034850 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:16.035300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:16.036082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:16.036563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:16.219631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:16.227884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2c7fbcaa-c740-478e-b7da-15c6ecd96ce5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.204704 Jan 28 01:27:16.228491 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 170/355] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:16 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:16.401128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:16.402959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:16.415613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:16.416383 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:16.417479 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:16.418038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:16.608209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:16.621617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-01da82ba-2af3-48be-9057-bca49b18759c tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1316 microversion: 2.1 time: 0.225224 Jan 28 01:27:16.622578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 186/356] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:16 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1316 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:16.969554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:16.969554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:16.975773 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:16.976465 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:16.978008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:16.978830 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:17.247492 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:17.248285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4ce53a6e-7a82-4d6c-b0c3-2535ac57f078 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29282 microversion: 2.20 time: 0.292336 Jan 28 01:27:17.248855 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:17.249200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 171/357] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:16 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29282 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:17.259250 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:17.260015 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:17.261510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:17.262299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:17.472482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:17.483083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7235ff65-62e7-44e8-b265-0f925af0c1b3 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.240254 Jan 28 01:27:17.484407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 187/358] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:17 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:17.646647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:17.647346 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:17.655677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:17.656108 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:17.656897 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:17.657343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:17.825029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:17.834054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f52bfb22-0817-421b-950b-2c0cd032a341 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1504 microversion: 2.1 time: 0.191959 Jan 28 01:27:17.834647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 172/359] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:17 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:18.265469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:18.266972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:18.294982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:18.295672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:18.296806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:18.297362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:18.449370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-09100124-d718-4d2f-b22b-b0ce37e0a47c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29282 microversion: 2.20 time: 0.187754 Jan 28 01:27:18.455755 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 188/360] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:18 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:18.511036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:18.511832 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:18.522930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:18.524017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:18.525600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:18.526300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:18.760686 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:18.772727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5a1fd212-133e-4c08-a0e0-0c6d2910bbae tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.268237 Jan 28 01:27:18.773712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 173/361] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:18 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:19.386059 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0495e142-15e9-41e5-9147-389b8ae3f3f3"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:19.387989 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:19.401143 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:19.402084 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:19.404637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:19.405775 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:19.469850 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:19.471952 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:19.483684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:19.484352 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:19.485501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:19.485942 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:19.679057 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1f7d2bd4-37dc-4108-b940-331b1da1add5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29282 microversion: 2.20 time: 0.218565 Jan 28 01:27:19.681682 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 174/362] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:19 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:19.799149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:19.799619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:19.807907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:19.808658 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:19.809670 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:19.810261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:19.907187 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a5002c3d-4d06-4cbf-bdd3-485ff33aa7d3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.527345 Jan 28 01:27:19.910038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 189/363] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:27:19 2022] POST /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:20.155892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:20.166757 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-95c4f249-6ce4-47d0-992d-244f9d019ea8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.372510 Jan 28 01:27:20.167907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 175/364] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:19 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:20.699461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:20.701394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:20.724932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:20.725937 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:20.728246 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:20.728955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:20.892833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2aba86ee-c344-43ac-a197-5c08ebf8ce99 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29282 microversion: 2.20 time: 0.199105 Jan 28 01:27:20.900258 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 190/365] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:20 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:21.188559 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:21.189655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:21.200967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:21.202001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:21.203502 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:21.204477 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:21.430638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:21.441343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b186f052-cb5d-4d4e-8124-2df67e0d2669 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.257684 Jan 28 01:27:21.453934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 176/366] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:21 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:21.911461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:21.913664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:21.924143 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:21.935832 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:21.938717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:21.939980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:22.078676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-021455ef-ee1f-4ce6-b26c-7a355a14a57e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29282 microversion: 2.20 time: 0.173233 Jan 28 01:27:22.083975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 191/367] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:21 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:22.463701 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:22.465033 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:22.476427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:22.477916 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:22.479786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:22.480832 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:22.701292 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:22.714622 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-48db7f4d-0c8c-4d14-b918-877978f07946 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.258162 Jan 28 01:27:22.725564 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 177/368] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:22 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:23.099018 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:23.100525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:23.108946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:23.109812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:23.110628 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:23.111297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:23.272968 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bdfb3945-618c-4e72-8eb3-685e33853d34 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29282 microversion: 2.20 time: 0.180797 Jan 28 01:27:23.281497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 192/369] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:23 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:23.737513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:23.738600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:23.753481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:23.754175 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:23.755588 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:23.756272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:23.983820 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:23.999054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-84f2424e-f0e1-447b-9b1e-b60b7c846c66 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.268765 Jan 28 01:27:24.010509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 178/370] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:23 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:24.292287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:24.294062 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:24.313505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:24.314350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:24.344160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:24.345339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:24.605242 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1b8d6c62-7775-40f0-9c73-2c6b288858bc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 29813 microversion: 2.20 time: 0.320037 Jan 28 01:27:24.605932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 193/371] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:24 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 29813 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:25.023745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:25.025431 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:25.035309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:25.036268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:25.037563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:25.038171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:25.458507 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:25.477482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-74a4453c-68a2-4012-bb6e-720f235c6253 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.458296 Jan 28 01:27:25.504290 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 179/372] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:25 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:25.621162 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:25.622217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:25.644258 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:25.644700 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:25.647465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:25.647904 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:25.857463 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-26b46d5a-1426-4620-9cd4-410335873890 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 30598 microversion: 2.20 time: 0.240458 Jan 28 01:27:25.858165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 194/373] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:25 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 30598 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:26.500558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:26.502135 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:26.532517 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:26.532976 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:26.535343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:26.538083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:26.873193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:26.874408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:26.888433 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:26.891890 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:26.892997 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:26.893627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:27.126652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3957f82c-ea9b-4b77-a2e3-5918167ec480 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 31545 microversion: 2.20 time: 0.257960 Jan 28 01:27:27.127303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 195/374] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:26 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 31545 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:27.198052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:27.229603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0afa831f-d80f-442a-b7e3-c2a66cf35263 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1501 microversion: 2.1 time: 0.726460 Jan 28 01:27:27.229603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 180/375] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:26 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1501 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:27.244995 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfd383d1-475e-4a97-bf51-c78eddcb9d3a"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:27.246735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:27.255560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:27.256515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:27.257649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:27.258244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:27.305734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] HTTP exception thrown: Cannot 'attach_volume' instance 96d2486b-d99e-4c1b-b15e-173a27da5960 while it is in vm_state rescued Jan 28 01:27:27.306340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Returning 409 to user: Cannot 'attach_volume' instance 96d2486b-d99e-4c1b-b15e-173a27da5960 while it is in vm_state rescued {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:27:27.307443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4edece95-c66a-46fb-9b44-607e4b9f7f83 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067692 Jan 28 01:27:27.317099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:27.317822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:27.322298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 196/376] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:27:27 2022] POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments => generated 152 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 01:27:27.326428 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:27.327240 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:27.328402 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:27.329079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:27.466907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2db3ca29-82b3-4e63-98ae-71f2ce06f59b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action" status: 202 len: 0 microversion: 2.1 time: 0.149939 Jan 28 01:27:27.475945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 181/377] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:27:27 2022] POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:27.486565 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:27.486565 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:27.502481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:27.505489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:27.507231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:27.509171 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:28.144283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:28.151644 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:28.169742 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:28.174339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:28.176036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:28.177001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:28.255466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:28.264913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0d8ff5ca-9159-43d6-9616-dcaa6dbd042b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1509 microversion: 2.1 time: 0.788868 Jan 28 01:27:28.265538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 197/378] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:27 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:28.411750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fb337a9a-67ad-40c2-a30d-57302cc60cb3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 33889 microversion: 2.20 time: 0.275466 Jan 28 01:27:28.412743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 182/379] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:28 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 33889 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:29.101319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0495e142-15e9-41e5-9147-389b8ae3f3f3"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:29.104371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:29.114463 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.115323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.117364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.118125 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.294992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:29.296875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:29.304188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] HTTP exception thrown: Invalid volume: volume 0495e142-15e9-41e5-9147-389b8ae3f3f3 is already attached to instances: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 Jan 28 01:27:29.314310 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Returning 400 to user: Invalid volume: volume 0495e142-15e9-41e5-9147-389b8ae3f3f3 is already attached to instances: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:27:29.319904 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4fab43d3-dc17-4d0d-b135-61369ff65ddd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221615 Jan 28 01:27:29.327418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 198/380] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:27:29 2022] POST /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments => generated 174 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:27:29.330557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.331017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.342035 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.344334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.432074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:29.433795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:29.463161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.464862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.470762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.471944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.709878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-163ed151-8154-41f4-880f-6d61dac128b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 34799 microversion: 2.20 time: 0.283936 Jan 28 01:27:29.710629 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 199/381] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:29 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 34799 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:29.726433 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:29.730735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:29.768748 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.777515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:29.782786 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:29.783378 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:30.116419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lazy-loading 'services' on Instance uuid 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:27:30.395681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-df22957c-77c0-41ef-a130-202d892f31ef tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments/0495e142-15e9-41e5-9147-389b8ae3f3f3" status: 202 len: 0 microversion: 2.1 time: 0.680035 Jan 28 01:27:30.403186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 200/382] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:27:29 2022] DELETE /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments/0495e142-15e9-41e5-9147-389b8ae3f3f3 => generated 0 bytes in 691 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:30.446101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:30.449399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:30.480695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:30.482507 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:30.484043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:30.485088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:30.572844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a7671740-9f91-4f7e-8d38-f86a8e84e323 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155601 Jan 28 01:27:30.579106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 201/383] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:27:30 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:30.752936 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:30.760203 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:30.779181 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:30.783837 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:30.785679 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:30.787150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:30.820127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:30.855171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4c6dc169-36d0-4e27-b192-dcc70fdce0c6 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1509 microversion: 2.1 time: 1.566338 Jan 28 01:27:30.879363 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 183/384] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:29 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1509 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:31.119532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7352896b-84d4-47b4-ae2d-7e78e0d77808 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 35470 microversion: 2.20 time: 0.397807 Jan 28 01:27:31.125683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 202/385] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:30 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 35470 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:31.596306 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:31.598989 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:31.618647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:31.622611 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:31.628242 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:31.633407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:31.757446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a44a26b9-dc91-40a1-9321-84f9632f2b16 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172864 Jan 28 01:27:31.761913 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 184/386] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:27:31 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:31.910011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:31.911234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:31.941963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:31.943508 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:31.945093 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:31.946102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:32.134734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:32.136121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:32.153335 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:32.154606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:32.156825 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:32.157935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:32.357074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8169f990-4fd8-4cda-9f21-b2a677b8a8e3 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 35884 microversion: 2.20 time: 0.226554 Jan 28 01:27:32.358678 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 185/387] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:32 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 35884 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:32.470007 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:32.484223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fca75109-8798-49e3-a389-945feaadd8c7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1509 microversion: 2.1 time: 0.583164 Jan 28 01:27:32.494471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 203/388] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:31 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1509 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:32.776924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:32.779262 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:32.791118 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:32.792002 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:32.793311 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:32.794036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:32.840318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5903d851-63e5-479a-936c-0889b9a02aea tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069440 Jan 28 01:27:32.841728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 186/389] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:27:32 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:27:33.250566 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1061661940", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "b39f7a55-675b-4821-a61a-a2d88e3cacd5"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:33.344211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] validate_networks() for [('b39f7a55-675b-4821-a61a-a2d88e3cacd5', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:27:33.372642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:33.373619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:33.388217 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:33.388576 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:33.391505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:33.391732 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:33.639765 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-12aadebe-9a2d-4051-b8b9-66f10a8d2858 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 36284 microversion: 2.20 time: 0.270949 Jan 28 01:27:33.641821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 187/390] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:33 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 36284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:33.653706 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:33.655886 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:33.669876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:33.671958 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:33.673289 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:33.674264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:34.269855 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:34.279292 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6a274d2a-7a9b-4723-bc17-b7319f0f751a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1509 microversion: 2.1 time: 0.635285 Jan 28 01:27:34.279875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 188/391] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:33 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1509 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:34.620583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:27:34.621915 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:27:34.623467 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:27:34.624156 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:27:34.624880 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:27:34.658359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:34.659297 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:34.675920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:34.676331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:34.684799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:34.687976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:34.688810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:34.693932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:34.697316 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:34.699694 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:34.765379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:27:34.777444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Getting quotas for user bdd86efb97ad48a994f04304a8459e54 and project 945f13b911d24a89a9d374a503d05cbb. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:27:34.793813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:27:34.797079 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:27:34.900316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c8bd3096-b6f7-4bfb-a580-479e9cebbcee tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 36749 microversion: 2.20 time: 0.246015 Jan 28 01:27:34.907381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 189/392] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:34 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 36749 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:34.918058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4f25e1a8-b084-445a-9e2e-ab8bbb6fc498 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.682845 Jan 28 01:27:34.919491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 204/393] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:27:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:27:34.940040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ee9c2310-f392-4e8a-b514-a773cad41f58 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:34.940040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ee9c2310-f392-4e8a-b514-a773cad41f58 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:35.133903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ee9c2310-f392-4e8a-b514-a773cad41f58 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:35.162958 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ee9c2310-f392-4e8a-b514-a773cad41f58 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1218 microversion: 2.1 time: 0.231624 Jan 28 01:27:35.167929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 190/394] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:34 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1218 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:35.315410 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:35.316785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:35.339954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:35.341083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:35.342890 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:35.343900 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:35.691113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:35.718261 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-74b3f4cd-269f-4696-bb1d-a5994b23c9f0 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1515 microversion: 2.1 time: 0.411372 Jan 28 01:27:35.722063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 205/395] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:35 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:35.932954 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:35.936848 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:35.954997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:35.956095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:35.957788 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:35.958771 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:36.189218 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a943dc13-9e5e-421c-b718-4bdaf83a43ea tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 37337 microversion: 2.20 time: 0.273964 Jan 28 01:27:36.197704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 191/396] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:35 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 37337 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:36.199508 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:36.200932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:36.223892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:36.225635 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:36.226617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:36.231036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:36.363615 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:36.373159 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9d67fdda-3c68-428c-b65d-a02619ddfd85 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1214 microversion: 2.1 time: 0.180937 Jan 28 01:27:36.374950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 206/397] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:36 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:37.211091 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:37.213546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:37.224367 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:37.225950 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:37.229797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:37.230841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:37.404612 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:37.405713 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:37.428365 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:37.429148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:37.430571 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:37.433843 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:37.470966 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f81013da-4da6-453e-a0bc-1e35cf55c963 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 38275 microversion: 2.20 time: 0.265400 Jan 28 01:27:37.477542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 192/398] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:37 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 38275 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:27:37.634239 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:37.635284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:37.647719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:37.648460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:37.649594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:37.658405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:37.723524 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:37.756770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-64386126-8eac-4883-86eb-e7f93c6c4360 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1278 microversion: 2.1 time: 0.359842 Jan 28 01:27:37.757801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 207/399] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:37 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1278 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:38.488510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:38.489946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:38.508303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:38.511970 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:38.513348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:38.514150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:38.540267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:38.554366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7750cfd9-de4e-4508-a121-fc4ee3eee4eb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1515 microversion: 2.1 time: 0.926305 Jan 28 01:27:38.557634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 193/400] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:37 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1515 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:38.580383 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "480f4f9d-9d32-4344-ae02-1c871d1b4d14"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:38.585944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:38.605723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:38.606753 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:38.608488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:38.611234 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:38.775749 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5b9a1605-9de6-412a-9ae8-e172c5b686db tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 38806 microversion: 2.20 time: 0.293138 Jan 28 01:27:38.784904 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 208/401] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:38 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 38806 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:38.798432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:38.801456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:38.824117 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:38.827303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:38.828364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:38.829368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:39.154514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:39.174626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-39593f39-31e7-4754-9b95-08f21c0008b0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1276 microversion: 2.1 time: 0.386004 Jan 28 01:27:39.175875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 209/402] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:38 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1276 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:39.351691 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cbd100b8-1102-4f97-bfce-551c8c43df64 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.779266 Jan 28 01:27:39.356683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 194/403] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:27:38 2022] POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments => generated 194 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:39.809919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:39.811776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:39.852154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:39.853024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:39.857644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:39.858306 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:40.102339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fe056cd4-d71a-4a8b-a53d-a9d82be2256e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 38806 microversion: 2.20 time: 0.307120 Jan 28 01:27:40.109502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 210/404] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:39 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 38806 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:40.197944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:40.199188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:40.234863 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:40.235963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:40.237422 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:40.238212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:41.016063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:41.060721 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ed32eae5-3c7b-41a8-90e5-77c0458152f6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.870804 Jan 28 01:27:41.066078 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 195/405] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:40 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:41.128551 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:41.138068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:41.192193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:41.193087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:41.196055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:41.196803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:41.460282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-15ae1f29-3d9e-4f30-b59d-dcc048bf4fc0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 38806 microversion: 2.20 time: 0.345944 Jan 28 01:27:41.461484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 211/406] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:41 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 38806 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:42.084645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:42.085746 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:42.117040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:42.117794 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:42.118986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:42.119585 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:42.477839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:42.478982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:42.499374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:42.500149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:42.503792 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:42.507224 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:42.552622 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:42.562688 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cbd3f35c-65c6-402b-86f8-77520ab57a5f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.488111 Jan 28 01:27:42.585562 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 196/407] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:42 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:42.717164 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-55f75789-82e3-4b33-8d5f-a2b26bf32d94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 38827 microversion: 2.20 time: 0.244539 Jan 28 01:27:42.719511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 212/408] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:42 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 38827 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:42.916943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-f7743f16-64f8-409a-8da5-e417aeb1db19 req-b2551eab-3f04-43b4-9733-044062fe4ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0d90966-8f1d-4d12-af12-972b3a89acfd", "tag": "ef934d62-a9bd-4d21-9f34-fff8d0f0185e"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:42.930022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:27:42.930022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:27:42.954256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-f7743f16-64f8-409a-8da5-e417aeb1db19 req-b2551eab-3f04-43b4-9733-044062fe4ef7 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:42.956697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-f7743f16-64f8-409a-8da5-e417aeb1db19 req-b2551eab-3f04-43b4-9733-044062fe4ef7 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:42.978712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-f7743f16-64f8-409a-8da5-e417aeb1db19 req-b2551eab-3f04-43b4-9733-044062fe4ef7 service nova] Creating event network-changed:ef934d62-a9bd-4d21-9f34-fff8d0f0185e for instance c0d90966-8f1d-4d12-af12-972b3a89acfd on hv-cinder-82662 Jan 28 01:27:43.022979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-f7743f16-64f8-409a-8da5-e417aeb1db19 req-b2551eab-3f04-43b4-9733-044062fe4ef7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106630 Jan 28 01:27:43.024337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 197/409] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:43.586280 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:43.587752 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:43.607660 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:43.609795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:43.611649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:43.612587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:43.735798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:43.737874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:43.746213 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:43.747297 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:43.748451 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:43.749033 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:43.909076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4f28ba99-eb59-4c64-96be-1c5f4b930162 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 200 len: 38947 microversion: 2.20 time: 0.181503 Jan 28 01:27:43.915025 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 198/410] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:43 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 38947 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:27:43.963445 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:43.967400 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:43.988958 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:43.991680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:43.995325 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:43.998255 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:44.045854 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d866d5fa-1a49-4444-883e-8dcf280a6038 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/ips" status: 200 len: 150 microversion: 2.20 time: 0.102055 Jan 28 01:27:44.046716 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 199/411] 10.222.0.16 () {60 vars in 1288 bytes} [Fri Jan 28 01:27:43 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/ips => generated 150 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:27:44.122180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:44.135467 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-60e87ec5-8075-4915-895e-f59c06dbe121 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.556716 Jan 28 01:27:44.144560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 213/412] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:43 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:45.163225 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:45.169021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:45.179256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:45.180719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:45.182036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:45.182691 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:45.695115 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:45.734189 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2b6eb428-f056-408c-a31f-4f1497ac13a1 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.581745 Jan 28 01:27:45.735716 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 200/413] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:45 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:46.762039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:46.765840 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:46.783901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:46.785493 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:46.787241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:46.788583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:47.553566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:47.560823 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:47.568663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:47.582997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:47.583394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1a5fa441-9219-4bbf-909a-54567e1d257f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.824919 Jan 28 01:27:47.584258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:47.586609 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 214/414] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:46 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:47.591900 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:47.592826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:47.655656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lazy-loading 'flavor' on Instance uuid ee84016d-9001-4252-b16e-a4c1a7999a5a {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:27:48.528287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:48.529877 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:48.563357 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:48.569686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:48.584468 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:48.590862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:48.679718 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lazy-loading 'flavor' on Instance uuid 96d2486b-d99e-4c1b-b15e-173a27da5960 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:27:48.772833 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d074dbfe-20ab-4c7f-88ea-30fb8ad5f08c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 202 len: 0 microversion: 2.20 time: 1.227338 Jan 28 01:27:48.775225 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 201/415] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:27:47 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:27:48.803680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:48.805675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:48.828179 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:48.830919 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:48.835157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:48.835876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:49.100264 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d0b2e5dd-8340-47b7-a26f-8f1279d2d660 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action" status: 200 len: 32 microversion: 2.1 time: 0.577929 Jan 28 01:27:49.108503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 215/416] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:27:48 2022] POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action => generated 32 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:27:49.119192 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:49.120950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:49.133940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:49.135323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:49.137152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:49.138867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:49.152617 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:49.188674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ed623485-57ac-4383-95ec-64e0fe123ce9 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.411203 Jan 28 01:27:49.215086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 202/417] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:48 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:49.225776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:49.227309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:49.242899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:49.244151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:49.245960 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:49.246954 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:50.314954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:50.331610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:50.335246 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:50.336816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-aa9afce1-4b14-4d13-90ab-6847dfd7671e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 1.225789 Jan 28 01:27:50.337623 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 216/418] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:49 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:27:50.348757 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1392708720", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:50.368865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:50.405896 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e080aa7b-e60d-4c08-9f4f-18c355a173ed tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 1.188473 Jan 28 01:27:50.413780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 203/419] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:49 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:50.446423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:50.447543 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:50.470039 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:50.475468 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:50.477714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:50.479292 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:50.507121 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] validate_networks() for None {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:27:51.159730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:51.175590 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1e6c01b5-7796-488e-95ae-9e2e4fc06ba3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.759806 Jan 28 01:27:51.176570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 204/420] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:50 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:51.226371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:27:51.226855 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:27:51.228657 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:27:51.229365 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:27:51.230019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:27:51.245337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:51.246418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:51.247474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:51.248502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:51.288994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Getting quotas for project 517c054d4f9a45a7b4ad85f0a1dc314c. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:27:51.298606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Getting quotas for user 9cc070e03a414e139ea18ee56963b53c and project 517c054d4f9a45a7b4ad85f0a1dc314c. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:27:51.330803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:27:51.343505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:27:51.450361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c715057e-a166-49ea-97d5-770a7094f039 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.104840 Jan 28 01:27:51.451172 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 217/421] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:27:51.518289 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:51.521935 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:51.538973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:51.542765 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:51.544652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:51.545953 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:51.903837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-36c6a531-c36f-4303-9c22-d59598a7ba94 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Action: 'create', calling method: .version_select at 0x7f7e76f92430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-423439306"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:51.924238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-36c6a531-c36f-4303-9c22-d59598a7ba94 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:27:51.928532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-36c6a531-c36f-4303-9c22-d59598a7ba94 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for user 6b11396acc67415abb08ddddf5680df8 and project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:27:51.968586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:51.978178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:51.979834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:51.981020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d13c85b5-3f0f-45df-907d-23f552a9df28 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.528994 Jan 28 01:27:51.981612 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 218/422] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:51 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:27:52.003979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:52.011722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:52.029884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.030816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.034244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.034860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.304496 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:52.319085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-75d1fe92-4ea2-42be-a54d-5a48d134738c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.328308 Jan 28 01:27:52.335202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 219/423] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:51 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:52.351959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:52.354793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:52.362027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-36c6a531-c36f-4303-9c22-d59598a7ba94 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:27:52.366265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.366748 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.367724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.368341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.368520 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-36c6a531-c36f-4303-9c22-d59598a7ba94 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for user 6b11396acc67415abb08ddddf5680df8 and project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'key_pairs'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:27:52.407881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-36c6a531-c36f-4303-9c22-d59598a7ba94 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 1.218652 Jan 28 01:27:52.418902 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 205/424] 10.222.0.16 () {60 vars in 1157 bytes} [Fri Jan 28 01:27:51 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:52.425478 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:52.426331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:52.435778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.436584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.437663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.438300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.459468 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:52.480893 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ef639c9a-863c-4d90-a61b-253f7dab7749 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1219 microversion: 2.1 time: 0.142545 Jan 28 01:27:52.482795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 220/425] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:52 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:52.767917 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:52.783102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-84cdcb43-357e-4b0d-b520-d20954c9c29e tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.366966 Jan 28 01:27:52.784632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-d99ad93b-a9c4-4971-a2eb-c641e975a78e req-be702a34-9513-49e5-8598-19f8ded7f023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d90966-8f1d-4d12-af12-972b3a89acfd", "name": "network-vif-plugged", "status": "completed", "tag": "ef934d62-a9bd-4d21-9f34-fff8d0f0185e"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:52.786695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:27:52.786695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:27:52.799049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 206/426] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:52 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:52.807734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-d99ad93b-a9c4-4971-a2eb-c641e975a78e req-be702a34-9513-49e5-8598-19f8ded7f023 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:52.808631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-d99ad93b-a9c4-4971-a2eb-c641e975a78e req-be702a34-9513-49e5-8598-19f8ded7f023 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:52.822529 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-d99ad93b-a9c4-4971-a2eb-c641e975a78e req-be702a34-9513-49e5-8598-19f8ded7f023 service nova] Creating event network-vif-plugged:ef934d62-a9bd-4d21-9f34-fff8d0f0185e for instance c0d90966-8f1d-4d12-af12-972b3a89acfd on hv-cinder-82662 Jan 28 01:27:52.828358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-d99ad93b-a9c4-4971-a2eb-c641e975a78e req-be702a34-9513-49e5-8598-19f8ded7f023 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047612 Jan 28 01:27:52.829887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 221/427] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:53.006993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:53.008434 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:53.022344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.022786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.023587 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.024017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.326252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:53.338542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:53.338542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:53.346362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:53.347205 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3506d668-f313-4283-aba0-77197e4ddd49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.347153 Jan 28 01:27:53.347392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:53.358032 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.359081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.360122 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.360787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.361336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 207/428] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:52 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:27:53.507223 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:53.508355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:53.525693 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.526471 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.528031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.528558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.643745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:53.666405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6df78e84-4e5b-4725-8d41-d91d328c5ab7 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1275 microversion: 2.1 time: 0.168637 Jan 28 01:27:53.668073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 208/429] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:53 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:53.815671 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:53.816726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:53.842560 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.844767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.848187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:53.850026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:53.856305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:53.874987 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1429a0bf-4851-4feb-9935-15e19113a761 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.533332 Jan 28 01:27:53.884768 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 222/430] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:53 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:27:54.277371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:54.287649 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5666dff1-3021-4247-805d-1b3b645b4517 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.480506 Jan 28 01:27:54.288979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 209/431] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:53 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:54.366113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:54.367568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:54.378675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:54.381950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:54.385672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:54.386704 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:54.684768 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:54.685690 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:54.694970 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:54.695851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:54.696988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:54.697644 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:54.791928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:54.806293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:54.809427 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:54.811719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a2141051-ac9c-4252-9218-75f6003196ff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.450110 Jan 28 01:27:54.829791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 223/432] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:54 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:27:54.851099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:54.866074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8d6471ae-2232-45e3-9b05-2a3a4420d97e tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1273 microversion: 2.1 time: 0.184472 Jan 28 01:27:54.867777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 210/433] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:54 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1273 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:54.894169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:54.894898 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:54.905665 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:54.907756 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:54.911419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:54.911961 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:55.254186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:55.267302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fdb55285-5443-4862-9b82-8bb472145dfe tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.378257 Jan 28 01:27:55.268164 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 224/434] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:54 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:55.310744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:55.312042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:55.318930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:55.319450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:55.320313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:55.320820 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:55.851076 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:55.861206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:55.898269 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:55.900592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:55.901399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:55.903189 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:55.905667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:55.911141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dbdf60b5-3f94-4df8-adc0-5b4d4519471f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1318 microversion: 2.1 time: 0.605564 Jan 28 01:27:55.927651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 211/435] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:55 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:55.927651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:55.927651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:55.932810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:55.932976 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:55.933810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:55.934458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:56.637498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:56.648747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:56.650663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:56.652568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7b7289f6-ff28-454b-bc81-5a353e9ecd1f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.815653 Jan 28 01:27:56.653889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 225/436] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:55 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:27:56.655213 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:56.663407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:56.665610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:56.669986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8891eb84-6dfd-4d8b-a4fa-0121d7f032fb tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.756472 Jan 28 01:27:56.670820 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 212/437] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:55 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:56.673940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:56.674488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:56.675408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:56.675941 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:56.938285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:56.939195 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:56.939368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:56.948126 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:56.948646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:56.949497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:56.949934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:56.950095 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9b493bf6-33ad-49cb-be30-ebe7c52611bb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.294183 Jan 28 01:27:56.950807 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 226/438] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:56 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:57.235949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:57.248198 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a84b8043-87d0-463f-b54d-7af0daa93ef3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1506 microversion: 2.1 time: 0.315749 Jan 28 01:27:57.251973 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 213/439] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:56 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1506 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:57.477912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-730e6fd6-07a0-4a78-989e-588cf57aa454 req-1528ede0-9f23-411e-b7d8-d9d85b455593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c783165-2441-4512-8370-55c6426edf17", "tag": "3a684b38-fc43-4a42-b315-7cdf949a486b"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:57.480619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:27:57.480619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:27:57.510305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-730e6fd6-07a0-4a78-989e-588cf57aa454 req-1528ede0-9f23-411e-b7d8-d9d85b455593 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:57.511237 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-730e6fd6-07a0-4a78-989e-588cf57aa454 req-1528ede0-9f23-411e-b7d8-d9d85b455593 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:57.528328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-730e6fd6-07a0-4a78-989e-588cf57aa454 req-1528ede0-9f23-411e-b7d8-d9d85b455593 service nova] Creating event network-changed:3a684b38-fc43-4a42-b315-7cdf949a486b for instance 6c783165-2441-4512-8370-55c6426edf17 on hv-cinder-82662 Jan 28 01:27:57.533977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-730e6fd6-07a0-4a78-989e-588cf57aa454 req-1528ede0-9f23-411e-b7d8-d9d85b455593 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062748 Jan 28 01:27:57.534599 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 227/440] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:27:57.676216 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:57.676832 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:57.698185 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:57.698943 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:57.731751 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:57.732569 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:57.734119 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:57.745265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:57.745918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:57.746784 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:57.747327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:57.756608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:58.116348 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:58.131511 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:58.134600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:58.136892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b4ea0498-b4f4-4f22-aa41-19c5513df828 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.465417 Jan 28 01:27:58.137984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 214/441] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:57 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:27:58.147080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:58.148285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:58.168496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:58.169288 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:58.170017 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:58.170612 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:58.171264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:58.182850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-63d7b43b-bdf9-4b7a-b0f0-439d0d56d764 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.491153 Jan 28 01:27:58.183930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 228/442] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:57 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:58.414539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:58.427677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-54067b09-15fd-4131-a901-9c86caedf713 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.288202 Jan 28 01:27:58.428288 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 215/443] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:58 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:58.838591 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79d14e98-21d4-4c23-978e-7e2998d24877"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:27:58.840619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:58.850970 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:58.851414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:58.852704 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:58.853473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.165598 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:59.166479 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:59.173643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:59.174108 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.175143 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:59.175584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.236141 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-182bd04d-3409-496f-a6cd-15297bc84083 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "POST /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405250 Jan 28 01:27:59.237531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 229/444] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:27:58 2022] POST /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments => generated 194 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:27:59.243428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:59.244528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:59.251934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:59.252686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.253733 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:59.254336 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.527346 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:59.543309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:59.546376 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:59.549060 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fb80fab2-f4ef-44d3-a532-55ba5a0c44a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.388279 Jan 28 01:27:59.550178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 216/445] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:27:59 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:27:59.558539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:27:59.559724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:27:59.570525 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:59.571347 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.572755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:27:59.573549 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:27:59.577425 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:59.591457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-07160342-64dc-46a7-9d00-131cf26793b5 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.352327 Jan 28 01:27:59.592061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 230/446] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:59 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:27:59.771671 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:27:59.785140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-038f6a14-ae40-467f-98f1-df749a000446 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.233193 Jan 28 01:27:59.786194 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 217/447] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:27:59 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:00.570799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:00.571677 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:00.578959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:00.579403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:00.580244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:00.580840 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:00.614047 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:00.615539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:00.623769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:00.624573 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:00.625753 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:00.626334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:00.806068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:00.825658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:00.827181 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:00.828529 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-15347a4c-89ae-40a1-a69d-b36f6c29298f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.261940 Jan 28 01:28:00.829174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 231/448] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:00 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:00.834001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:00.839860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:00.841098 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:00.843819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c0e54841-e9e8-4a21-8807-4fb0d3d18388 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.234721 Jan 28 01:28:00.845258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 218/449] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:00 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:00.852893 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:00.853888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:00.854959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:00.855558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:01.039878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:01.048563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-316af995-1182-470b-ada0-1092b01457a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.218053 Jan 28 01:28:01.049359 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 232/450] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:00 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:01.865616 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:01.865616 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:01.874027 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:01.878337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:01.889669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:01.890799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:01.892118 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:01.892874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:01.893239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:01.894256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:01.895704 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:01.896782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:02.185793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:02.197676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:02.200948 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:02.203301 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:02.204974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-96db8c57-4531-4667-ab2a-96f72e78f3b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.350619 Jan 28 01:28:02.205647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 219/451] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:01 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:02.210203 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1deb1093-2004-4746-b123-550af9833b4d tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.342381 Jan 28 01:28:02.211514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 233/452] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:01 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:02.213639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:02.214674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:02.224799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:02.225653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:02.227003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:02.227865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:02.417130 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:02.432091 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ee443dcf-dac8-4a9c-a368-e8570b4ca15b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.224475 Jan 28 01:28:02.433089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 220/453] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:02 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:03.238375 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:03.240473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:03.241827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:03.242451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:03.248924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:03.249650 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:03.250078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:03.250608 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:03.250999 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:03.251564 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:03.251727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:03.252191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:03.566596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:03.578057 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:03.579576 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:03.581972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-18e5b161-3651-462b-87de-6dd5c0085106 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.350096 Jan 28 01:28:03.582239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 234/454] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:03 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:03.587491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:03.588753 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:03.600115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:03.602205 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:03.603231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:03.603874 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:03.620514 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:03.642262 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3d13ef74-39da-46a4-9aad-a46adde3c3c0 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.410738 Jan 28 01:28:03.643355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 221/455] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:03 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:03.807127 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:03.815779 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7d91aebd-9e31-4dbd-8273-bbb37d0c2ed7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.232339 Jan 28 01:28:03.816475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 235/456] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:03 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:04.607805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:04.608574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:04.615686 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:04.616310 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:04.617398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:04.617937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:04.663959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:04.664689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:04.671696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:04.672235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:04.673103 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:04.673658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:04.922695 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:04.931737 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:04.934024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:04.935953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b2342894-6a72-438b-9531-b94ad4657900 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1741 microversion: 2.20 time: 0.331715 Jan 28 01:28:04.935953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 222/457] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:04 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1741 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:04.939997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:04.940749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:04.950995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:04.951865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:04.953354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:04.954868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:04.962966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:04.971448 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a2069d4c-3196-48ef-9db4-30f48ef28669 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.311027 Jan 28 01:28:04.972319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 236/458] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:04 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:05.131634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:05.142646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b9e7aed0-ca57-47fc-852a-dec5baf2cfad tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.206236 Jan 28 01:28:05.143131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 223/459] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:04 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:05.955762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:05.956931 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:05.963513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:05.964058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:05.964977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:05.965762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:05.992739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:05.995979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:06.016433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:06.017167 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:06.018728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:06.019482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:06.328523 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:06.341898 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-845b506a-146b-4b29-a770-65a5f52d1905 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.352817 Jan 28 01:28:06.342299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:06.343868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 224/460] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:05 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:06.350688 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-7129d667-cfb4-47a1-9d7b-2ca7fc7a1584 req-493776d4-f083-47bf-b7cb-1222fe516702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c783165-2441-4512-8370-55c6426edf17", "name": "network-vif-plugged", "status": "completed", "tag": "3a684b38-fc43-4a42-b315-7cdf949a486b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:06.353312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:06.353312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:06.359674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:06.362432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:06.363653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8fd74961-b3f5-4118-be6a-92f7a04498e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1741 microversion: 2.20 time: 0.411781 Jan 28 01:28:06.364027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-7129d667-cfb4-47a1-9d7b-2ca7fc7a1584 req-493776d4-f083-47bf-b7cb-1222fe516702 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:06.364361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 237/461] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:05 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1741 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:06.365014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-7129d667-cfb4-47a1-9d7b-2ca7fc7a1584 req-493776d4-f083-47bf-b7cb-1222fe516702 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:06.369322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:06.370160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:06.377699 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:06.378453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:06.379403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:06.379999 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:06.383284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-7129d667-cfb4-47a1-9d7b-2ca7fc7a1584 req-493776d4-f083-47bf-b7cb-1222fe516702 service nova] Creating event network-vif-plugged:3a684b38-fc43-4a42-b315-7cdf949a486b for instance 6c783165-2441-4512-8370-55c6426edf17 on hv-cinder-82662 Jan 28 01:28:06.391396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-7129d667-cfb4-47a1-9d7b-2ca7fc7a1584 req-493776d4-f083-47bf-b7cb-1222fe516702 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045210 Jan 28 01:28:06.392833 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 225/462] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:06.599234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:06.618309 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4d0af841-5bd4-4aeb-bc64-94c5b5a7fa53 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.252290 Jan 28 01:28:06.632773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 238/463] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:06 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:07.364812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:07.366140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:07.375308 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:07.375749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:07.376640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:07.377049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:07.390378 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:07.398076 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:07.412979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:07.417783 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:07.420068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:07.421610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:07.671399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:07.675931 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:07.679671 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dc775162-85ac-47d0-adba-b3068b5ae9c2 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1315 microversion: 2.1 time: 0.322214 Jan 28 01:28:07.680552 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 226/464] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:07 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:07.685407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:07.686019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:07.692042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:07.692726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:07.693822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:07.694459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:07.697971 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:07.701029 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:07.703206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c22427ad-e687-473a-8e8a-133445a88cbf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1741 microversion: 2.20 time: 0.318071 Jan 28 01:28:07.704115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 239/465] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:07 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1741 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:07.876976 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:07.891102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0aafe640-eff7-4a87-a5b8-860712b6dcec tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.208849 Jan 28 01:28:07.901860 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 227/466] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:07 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:08.229782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:08.231330 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:08.240331 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.240825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.241992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.242472 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.380241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lazy-loading 'services' on Instance uuid c0d90966-8f1d-4d12-af12-972b3a89acfd {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:28:08.524724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-913b3e3e-b526-4f5f-8b7f-43bf60762598 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments/79d14e98-21d4-4c23-978e-7e2998d24877" status: 202 len: 0 microversion: 2.1 time: 0.300024 Jan 28 01:28:08.529537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 240/467] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:28:08 2022] DELETE /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments/79d14e98-21d4-4c23-978e-7e2998d24877 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:28:08.544561 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:08.547526 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:08.579827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.581927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.583995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.585291 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.669859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-af6209bf-fda9-445d-9646-34d06487b21f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134772 Jan 28 01:28:08.671268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 228/468] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:28:08 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:08.717766 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:08.722192 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:08.735231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:08.736820 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:08.751171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.753907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.756714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.758085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.774518 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.775275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:08.802155 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:08.803554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.112086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:09.129300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:09.132625 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:09.135419 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-eb59a6a5-aa51-4014-84db-bbb0a8c3b268 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.406557 Jan 28 01:28:09.153753 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 229/469] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:08 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:09.158741 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:09.166078 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:09.167410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:09.167827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cc356cac-3685-4440-a003-79b33fe08b69 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1465 microversion: 2.1 time: 0.465508 Jan 28 01:28:09.168435 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 241/470] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:08 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1465 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:09.180499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.181989 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.183797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.184869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.240464 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:09.241490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:09.251841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.252776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.253865 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.254545 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.296732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:09.410630 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:09.429838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-613d8537-aef3-4a45-826f-c575db913ebb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.274248 Jan 28 01:28:09.430777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 230/471] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:09 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:09.458820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-340c5319-dfb8-48bd-ac15-f795a27cfe1c tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 204 len: 0 microversion: 2.1 time: 0.223580 Jan 28 01:28:09.469901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 242/472] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:09 2022] DELETE /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:09.475156 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:09.482158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:09.493725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.494184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.495082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.495447 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.690295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:09.697282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:09.709289 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.710135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.711056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:09.711810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:09.752403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-21a315c0-1d2e-4f37-820e-ceb35fb0f83b tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070411 Jan 28 01:28:09.757276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 243/473] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:28:09 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:10.179926 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:10.193708 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:10.209670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.210625 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.212223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.212719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:10.220050 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.222638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c6a4bd9d-988e-4fae-a06f-11fb5e3abe35 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1471 microversion: 2.1 time: 0.755131 Jan 28 01:28:10.223293 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 231/474] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:09 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1471 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:10.267426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-01772d96-f25a-4fa9-b086-03ac45eca4c0 req-d470a9b8-19d5-422b-a247-5f7f0dea2cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "name": "network-vif-plugged", "status": "completed", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:10.269105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:10.269105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:10.282472 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-01772d96-f25a-4fa9-b086-03ac45eca4c0 req-d470a9b8-19d5-422b-a247-5f7f0dea2cbc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.283681 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-01772d96-f25a-4fa9-b086-03ac45eca4c0 req-d470a9b8-19d5-422b-a247-5f7f0dea2cbc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.301043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-01772d96-f25a-4fa9-b086-03ac45eca4c0 req-d470a9b8-19d5-422b-a247-5f7f0dea2cbc service nova] Creating event network-vif-plugged:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:28:10.316016 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-01772d96-f25a-4fa9-b086-03ac45eca4c0 req-d470a9b8-19d5-422b-a247-5f7f0dea2cbc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044058 Jan 28 01:28:10.318177 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 232/475] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:10.464466 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:10.467142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:10.478390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.481398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.483575 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.484692 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.503190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:10.519504 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:10.521931 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:10.523707 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-115fecc0-cc97-4cb1-9bef-2d619adfba37 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.355585 Jan 28 01:28:10.525034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 244/476] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:10 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:10.766112 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:10.768243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:10.795834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.796560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.797962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:10.799261 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:10.821703 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:10.843313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2aba81cc-dc73-42d7-8907-4982f299df06 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.389651 Jan 28 01:28:10.857075 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 233/477] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:10 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:10.875028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b4bd74f9-7570-4c28-a62d-822a815fd33f tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113916 Jan 28 01:28:10.880954 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 245/478] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:28:10 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:11.254099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:11.256190 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:11.266621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.267347 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.268816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.269740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.510203 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:11.523729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-60eca1d9-e228-447b-a9e8-53ef470e8c55 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1471 microversion: 2.1 time: 0.275352 Jan 28 01:28:11.527230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 234/479] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:11 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:11.547337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:11.548948 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:11.561439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.562613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.564247 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.565525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.827241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:11.845635 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:11.848368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:11.850673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5d3dec58-8e21-4361-88db-bd2228b8e040 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.310410 Jan 28 01:28:11.852913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 246/480] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:11 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:11.875015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:11.875606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:11.882656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.883433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.884324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.884745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.890364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:11.891963 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:11.902678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.903013 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.903754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:11.904184 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:11.972327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-57f48c23-5e49-482b-9a63-5bf0c777ff20 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085610 Jan 28 01:28:11.974069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 247/481] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:28:11 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd/os-volume_attachments => generated 25 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:28:12.130245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:12.146863 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-77bfb397-db04-48b2-a3c0-88e288c35890 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1567 microversion: 2.1 time: 0.274805 Jan 28 01:28:12.163875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 235/482] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:11 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:12.556136 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:12.557659 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:12.568815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:12.569611 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:12.571086 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:12.571877 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:12.882727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:12.887595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:12.890705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:12.897765 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f6b609f2-afe2-479a-b259-b99942ff82de tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1471 microversion: 2.1 time: 0.348818 Jan 28 01:28:12.901853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 248/483] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:12 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1471 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:12.904158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:12.904789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:12.905725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:12.906379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.161002 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:13.173098 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:13.174379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:13.197345 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.200102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.201182 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.201769 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.210694 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:13.219423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:13.224444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5dd475cc-6e6d-4906-9915-babe6c36b1e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.345707 Jan 28 01:28:13.225634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 236/484] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:12 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:13.312644 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:13.314064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:13.326845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.327387 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.328256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.328885 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.376805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:13.520503 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ff35f431-24ee-4ee8-89b4-0250c1a55ea4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 204 len: 0 microversion: 2.1 time: 0.212020 Jan 28 01:28:13.521337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 237/485] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:13 2022] DELETE /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:13.535174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:13.536180 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:13.547891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.549076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.551744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.552738 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.656574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:13.674387 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2fda71df-e7bf-47cc-80b7-da8780d4dd5c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1547 microversion: 2.1 time: 0.505462 Jan 28 01:28:13.689741 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 249/486] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:13 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1547 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:13.704946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:13.706562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:13.728267 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.729295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.731193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.732209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.807302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:13.821834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-faa7bea0-4276-411e-a8bc-0930780e0136 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1512 microversion: 2.1 time: 0.293168 Jan 28 01:28:13.833715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 238/487] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:13 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:13.907196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] HTTP exception thrown: Cannot 'detach_volume' instance 96d2486b-d99e-4c1b-b15e-173a27da5960 while it is in vm_state rescued Jan 28 01:28:13.908967 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Returning 409 to user: Cannot 'detach_volume' instance 96d2486b-d99e-4c1b-b15e-173a27da5960 while it is in vm_state rescued {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:13.912235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-86f3ac2f-dba9-4c81-9821-0fa8058cdf44 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments/480f4f9d-9d32-4344-ae02-1c871d1b4d14" status: 409 len: 152 microversion: 2.1 time: 0.212298 Jan 28 01:28:13.913896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 250/488] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:28:13 2022] DELETE /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments/480f4f9d-9d32-4344-ae02-1c871d1b4d14 => generated 152 bytes in 215 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 28 01:28:13.933579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:13.934438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:13.934949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:13.938437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:13.955634 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.957008 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.958414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.959147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.963008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.963769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:13.965260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:13.978823 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.144221 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-eccb26da-37d3-48a6-8ce2-06f17dd73ab8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action" status: 202 len: 0 microversion: 2.1 time: 0.215523 Jan 28 01:28:14.146397 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 239/489] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:28:13 2022] POST /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:28:14.157839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:14.158579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:14.184540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.201953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.204723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.213900 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.494102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:14.518796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3a772318-bd3d-47ee-8eea-13431698b81f tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1471 microversion: 2.1 time: 0.583268 Jan 28 01:28:14.529449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 251/490] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:13 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:14.550533 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:14.551912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:14.571715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.572402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.573702 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.574399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.784828 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:14.800127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0da5f4dc-8f11-4902-b3a0-34d7455d6db7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1555 microversion: 2.1 time: 0.647605 Jan 28 01:28:14.800741 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 240/491] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:14 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1555 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:14.806313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-96e7493e-b516-44b5-aed5-c473593d8c45 req-d4ac1661-21d7-40b2-a455-3c113905fdee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c783165-2441-4512-8370-55c6426edf17", "name": "network-vif-deleted", "tag": "3a684b38-fc43-4a42-b315-7cdf949a486b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:14.816570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:14.816570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:14.825316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-96e7493e-b516-44b5-aed5-c473593d8c45 req-d4ac1661-21d7-40b2-a455-3c113905fdee service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.826076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-96e7493e-b516-44b5-aed5-c473593d8c45 req-d4ac1661-21d7-40b2-a455-3c113905fdee service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.840797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-96e7493e-b516-44b5-aed5-c473593d8c45 req-d4ac1661-21d7-40b2-a455-3c113905fdee service nova] Creating event network-vif-deleted:3a684b38-fc43-4a42-b315-7cdf949a486b for instance 6c783165-2441-4512-8370-55c6426edf17 on hv-cinder-82662 Jan 28 01:28:14.847404 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-96e7493e-b516-44b5-aed5-c473593d8c45 req-d4ac1661-21d7-40b2-a455-3c113905fdee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044580 Jan 28 01:28:14.850027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 241/492] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:14.857480 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:14.858866 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:14.869703 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.870452 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:14.871869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:14.872659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:15.098126 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:15.114810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:15.118644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:15.122359 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-823456d2-9b55-4cde-90d8-91f3e7f5c114 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.590287 Jan 28 01:28:15.124711 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 252/493] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:14 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:15.345266 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:15.358756 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8a38e4c4-ef11-4105-b0ce-9c276e9b3589 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1512 microversion: 2.1 time: 0.508192 Jan 28 01:28:15.373971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 242/494] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:14 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1512 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:15.552857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:15.554586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:15.566962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:15.567815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:15.569683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:15.570836 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:15.634862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:15.635597 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:15.636220 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lazy-loading 'fault' on Instance uuid 6c783165-2441-4512-8370-55c6426edf17 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:28:15.707970 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc070e03a414e139ea18ee56963b53c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517c054d4f9a45a7b4ad85f0a1dc314c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:15.719546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d10ebb22-029c-4eb4-a70a-1a4857251cec tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 200 len: 1305 microversion: 2.1 time: 0.173368 Jan 28 01:28:15.720303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 253/495] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:15 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 1305 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:15.822612 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:15.823617 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:15.836064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:15.836925 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:15.838480 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:15.839242 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.097083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:16.107635 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a3b2d487-94bc-432f-a7bd-b6e94cda49e4 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1555 microversion: 2.1 time: 0.292496 Jan 28 01:28:16.108413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 243/496] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:15 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:16.151049 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:16.153203 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:16.164261 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:16.165312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.166667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:16.167185 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.386039 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:16.388122 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:16.407173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:16.408370 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.409797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:16.411389 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.435492 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:16.453287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:16.456607 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:16.458892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9c40d635-85e5-40d5-8235-0c135b1843a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.316467 Jan 28 01:28:16.460238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 254/497] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:16 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:16.671970 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:16.685999 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8e9f32be-092d-42a7-b768-a1288f5e3bf6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1512 microversion: 2.1 time: 0.303990 Jan 28 01:28:16.687017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 244/498] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:16 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:16.745858 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:16.747365 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] [instance: 6c783165-2441-4512-8370-55c6426edf17] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:16.760910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:16.761869 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.763305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:16.764102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:16.786700 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] HTTP exception thrown: Instance 6c783165-2441-4512-8370-55c6426edf17 could not be found. Jan 28 01:28:16.787681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] Returning 404 to user: Instance 6c783165-2441-4512-8370-55c6426edf17 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:16.788950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4e3f410d-69f2-48ee-94be-17c6b31a4254 tempest-VolumesNegativeTest-2028536523 tempest-VolumesNegativeTest-2028536523-project] 10.222.0.16 "GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17" status: 404 len: 111 microversion: 2.1 time: 0.049392 Jan 28 01:28:16.790649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 255/499] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:16 2022] GET /compute/v2.1/servers/6c783165-2441-4512-8370-55c6426edf17 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:28:17.133878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:17.134810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:17.147117 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:17.147954 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:17.149670 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:17.150337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:17.340901 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:17.350874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-46a69771-fd2f-435a-8299-53bb69429a3b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1555 microversion: 2.1 time: 0.221014 Jan 28 01:28:17.351451 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 245/500] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:17 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1555 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:17.480146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:17.480771 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:17.487364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:17.487893 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:17.488740 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:17.489201 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:17.713747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:17.714486 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:17.720748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:17.721196 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:17.722010 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:17.722446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:17.780297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:17.802564 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:17.806256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:17.818944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ece30751-f862-4fb7-bca3-0ce42c3c7c90 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.342813 Jan 28 01:28:17.830419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 256/501] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:17 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:18.059100 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:18.073858 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5cb887c5-50cd-422b-bdb2-865683098e88 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1512 microversion: 2.1 time: 0.364683 Jan 28 01:28:18.075277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 246/502] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:17 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:18.369419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:18.370344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:18.379054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:18.379802 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:18.381396 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:18.382586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:18.503674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-03a97acd-2039-4a60-bb55-16a930e00653 req-c28452e7-94d9-42e4-8325-125d0edfc9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0d90966-8f1d-4d12-af12-972b3a89acfd", "name": "network-vif-deleted", "tag": "ef934d62-a9bd-4d21-9f34-fff8d0f0185e"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:18.506384 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:18.506384 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:18.519958 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-03a97acd-2039-4a60-bb55-16a930e00653 req-c28452e7-94d9-42e4-8325-125d0edfc9ab service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:18.520549 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-03a97acd-2039-4a60-bb55-16a930e00653 req-c28452e7-94d9-42e4-8325-125d0edfc9ab service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:18.534207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-03a97acd-2039-4a60-bb55-16a930e00653 req-c28452e7-94d9-42e4-8325-125d0edfc9ab service nova] Creating event network-vif-deleted:ef934d62-a9bd-4d21-9f34-fff8d0f0185e for instance c0d90966-8f1d-4d12-af12-972b3a89acfd on hv-cinder-82662 Jan 28 01:28:18.540244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-03a97acd-2039-4a60-bb55-16a930e00653 req-c28452e7-94d9-42e4-8325-125d0edfc9ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044998 Jan 28 01:28:18.541669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 247/503] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:18.650896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:18.666509 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bfb86cfa-80e0-4025-ac8f-fbe933dcf64d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1555 microversion: 2.1 time: 0.299852 Jan 28 01:28:18.668380 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 257/504] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:18 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1555 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:18.844280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:18.845780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:18.855697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:18.856352 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:18.858049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:18.858808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:19.106617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:19.108825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:19.143297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:19.144041 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:19.145422 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:19.152477 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:19.224621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:19.225376 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:19.226129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lazy-loading 'fault' on Instance uuid c0d90966-8f1d-4d12-af12-972b3a89acfd {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:28:19.230548 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:19.243527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:19.246912 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:19.249010 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6ee516d2-2770-45af-b7bf-0cf8cd054b84 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.413527 Jan 28 01:28:19.250154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 248/505] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:18 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:19.317988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:19.339512 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-80aada1a-2eae-4364-82d0-69d16f9516c8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 200 len: 1308 microversion: 2.1 time: 0.242002 Jan 28 01:28:19.340950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 258/506] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:19 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:19.699722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1998095975", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423439306", "security_groups": [{"name": "tempest-secgroup-smoke-180707503"}], "block_device_mapping_v2": [{"uuid": "b5b403a0-d7b7-4fa8-aeec-2828e53728e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73ebb25b-4b41-4be2-af3a-88e69f998b5e"}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:19.709901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:19.712226 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:19.733791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:19.734600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:19.735943 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:19.737606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:19.927676 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] validate_networks() for [('73ebb25b-4b41-4be2-af3a-88e69f998b5e', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:28:20.137671 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:20.155846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31cd08ee-1758-4468-a2c0-4d78ad5d4291 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1561 microversion: 2.1 time: 0.453470 Jan 28 01:28:20.167091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 259/507] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:19 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1561 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:20.242932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:20.260056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:20.282965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.283759 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.285182 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.291426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.444116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lazy-loading 'services' on Instance uuid 96d2486b-d99e-4c1b-b15e-173a27da5960 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:28:20.591315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6202ec2a-243e-498a-ae91-936c0ded1ae8 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments/480f4f9d-9d32-4344-ae02-1c871d1b4d14" status: 202 len: 0 microversion: 2.1 time: 0.355854 Jan 28 01:28:20.593295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 260/508] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:28:20 2022] DELETE /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments/480f4f9d-9d32-4344-ae02-1c871d1b4d14 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:28:20.600972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:28:20.601899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:28:20.602398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:28:20.602939 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:28:20.603358 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:28:20.606605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:20.608178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:20.642498 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.643214 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.644323 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.645171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.647883 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.651596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.652997 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.658230 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.671637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:28:20.676672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for user 6b11396acc67415abb08ddddf5680df8 and project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:28:20.813780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:28:20.816674 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5b403a0-d7b7-4fa8-aeec-2828e53728e1',volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:28:20.888593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:20.899162 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:20.901595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:20.903311 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-96b96d80-5c83-4bfa-a85d-43bc8d34acff tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.307516 Jan 28 01:28:20.916747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 261/509] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:20 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:20.924459 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:20.925069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: c0d90966-8f1d-4d12-af12-972b3a89acfd] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:20.934648 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.935110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.935941 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.936374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.952926 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] HTTP exception thrown: Instance c0d90966-8f1d-4d12-af12-972b3a89acfd could not be found. Jan 28 01:28:20.953992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Returning 404 to user: Instance c0d90966-8f1d-4d12-af12-972b3a89acfd could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:20.955154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9bac4280-f41d-4187-af24-7334dc4b90c3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd" status: 404 len: 111 microversion: 2.1 time: 0.039043 Jan 28 01:28:20.956654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 262/510] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:20 2022] GET /compute/v2.1/servers/c0d90966-8f1d-4d12-af12-972b3a89acfd => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:20.961942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:20.963076 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:20.972861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.974196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:20.976195 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:20.976974 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:21.022463 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-46634076-5d9e-45c8-b38a-3f9574a39ccb tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064388 Jan 28 01:28:21.023378 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 263/511] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:28:20 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:21.118694 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: ERROR oslo.messaging._drivers.impl_rabbit [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [17779c37-597c-42a9-88df-059fc6a5c970] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 28 01:28:21.953132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:21.956209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:21.967731 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:21.968753 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:21.969640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:21.970120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.133129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO oslo.messaging._drivers.impl_rabbit [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [17779c37-597c-42a9-88df-059fc6a5c970] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 50316. Jan 28 01:28:22.143633 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-97226496-e5f6-42d4-8b95-fd40677d0640 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.447625 Jan 28 01:28:22.154322 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 249/512] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:28:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 2459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:28:22.164043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:22.166232 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:22.179251 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:22.179836 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.196183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:22.196973 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.283174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-27a23b86-7fa3-41ce-b56b-00acaa7d783d tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.127624 Jan 28 01:28:22.283777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 250/513] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:28:22 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:28:22.296139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-42dea197-86d6-4609-9451-5e5a32165b1d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:22.296748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-42dea197-86d6-4609-9451-5e5a32165b1d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:22.365028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:22.374516 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:22.381177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:22.386700 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e2f0a04d-d124-4583-8c6f-0ec21227f2ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.465251 Jan 28 01:28:22.390274 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 264/514] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:21 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:22.403152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:22.404009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:22.423636 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:22.424160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.425087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:22.425605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.439917 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-42dea197-86d6-4609-9451-5e5a32165b1d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:22.448897 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-42dea197-86d6-4609-9451-5e5a32165b1d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1094 microversion: 2.1 time: 0.163912 Jan 28 01:28:22.450587 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 251/515] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:22 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1094 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:22.466742 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:22.588986 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a510655e-983f-43cc-bf0e-662b83a856d2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 204 len: 0 microversion: 2.1 time: 0.196866 Jan 28 01:28:22.591884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 265/516] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:22 2022] DELETE /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:22.604879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:22.605991 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:22.623891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:22.625393 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.633634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:22.635043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:22.847239 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:22.875391 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-edd7bec7-df2f-4baa-9333-4b207a716959 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1510 microversion: 2.1 time: 0.275477 Jan 28 01:28:22.878251 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 252/517] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:22 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:23.412020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:23.414783 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:23.426390 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:23.427588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:23.428677 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:23.429474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:23.469857 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:23.469857 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:23.480705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:23.481681 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:23.482726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:23.483618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:23.594843 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:23.609606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6287b6a1-51c8-4744-b73a-f14c426f8aef tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1192 microversion: 2.1 time: 0.139347 Jan 28 01:28:23.625691 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 253/518] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:23 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1192 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:23.700412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:23.710171 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:23.711719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:23.712969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a24248da-be43-4a1a-8cb3-0c5be23aac7a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1736 microversion: 2.20 time: 0.308717 Jan 28 01:28:23.713800 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 266/519] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:23 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1736 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:23.899538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:23.900814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:23.912083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:23.912816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:23.914082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:23.914933 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.112393 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:24.125742 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-199ee326-0d7b-42e4-bd18-62af6195f999 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1510 microversion: 2.1 time: 0.232620 Jan 28 01:28:24.127310 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 254/520] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:23 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:24.623495 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:24.633578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:24.643981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:24.644455 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.645302 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:24.645746 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.734263 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:24.734870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:24.742071 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:24.742727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.743747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:24.744296 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.825436 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:24.836889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0bd6319a-8461-4a77-a8a6-f1004d95e875 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1210 microversion: 2.1 time: 0.217970 Jan 28 01:28:24.837506 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 267/521] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:24 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1210 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:24.842085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:24.842608 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:24.849406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:24.850150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.850945 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:24.852124 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:24.890558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:25.027321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f1c42b04-14a0-4f07-a2ba-cafc7fc7ef2b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 204 len: 0 microversion: 2.1 time: 0.188242 Jan 28 01:28:25.028336 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 268/522] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:24 2022] DELETE /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:25.040091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:25.041609 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:25.050693 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:25.051280 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:25.052129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:25.052532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:25.092489 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:25.105396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:25.108483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:25.110794 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ba7e7cb5-08ff-4a20-abf4-98b2f658c84b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1718 microversion: 2.20 time: 0.381421 Jan 28 01:28:25.112278 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 255/523] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:24 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1718 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:25.149506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:25.150285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:25.160680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:25.161436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:25.162698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:25.163357 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:25.455847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:25.466572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4d49c6a9-5aec-4a3d-88f8-090b9b900962 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1508 microversion: 2.1 time: 0.432288 Jan 28 01:28:25.467587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 269/524] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:25 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1508 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:25.529356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:25.538914 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-db292b05-0a95-4e0d-888a-ee62134e5ddf tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1510 microversion: 2.1 time: 0.397268 Jan 28 01:28:25.539719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 256/525] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:25 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:25.870228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:25.872091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:25.886491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:25.887135 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:25.890153 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:25.890838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.130950 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:26.132235 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:26.139557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:26.140228 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.147173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:26.157707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.229416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:26.242319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b039c4f8-e976-4423-bf25-51d98d66f30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.376286 Jan 28 01:28:26.242914 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 270/526] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:25 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:26.493772 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:26.494347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:26.505510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:26.505798 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.507188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:26.508092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.543412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:26.563398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:26.565028 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:26.566220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a32c2b30-930a-4599-a0c9-24046ac0305f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1718 microversion: 2.20 time: 0.439549 Jan 28 01:28:26.566782 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 257/527] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:26 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1718 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:26.583035 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:26.583726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:26.590306 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:26.591090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.591905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:26.592302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:26.925105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:26.933399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-249726ab-5c2a-4ee4-a7b3-3d2485fe7b8e tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1508 microversion: 2.1 time: 0.448102 Jan 28 01:28:26.933982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 271/528] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:26 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1508 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:27.050276 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:27.060388 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0837f02f-7ad4-4487-8a92-13ca8ffbc8a0 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 200 len: 1510 microversion: 2.1 time: 0.481172 Jan 28 01:28:27.061448 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 258/529] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:26 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 1510 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:27.105271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-c67e49cc-b427-46e8-b9c2-94d7dd11ce78 req-5e9ef504-d3a7-4c23-a4f7-c4e345daf9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4", "name": "network-vif-deleted", "tag": "340324e7-17ea-494c-be8f-764631958e2f"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:27.108119 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:27.108119 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:28:27.122252 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-c67e49cc-b427-46e8-b9c2-94d7dd11ce78 req-5e9ef504-d3a7-4c23-a4f7-c4e345daf9a8 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.129809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-c67e49cc-b427-46e8-b9c2-94d7dd11ce78 req-5e9ef504-d3a7-4c23-a4f7-c4e345daf9a8 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:27.165661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-c67e49cc-b427-46e8-b9c2-94d7dd11ce78 req-5e9ef504-d3a7-4c23-a4f7-c4e345daf9a8 service nova] Creating event network-vif-deleted:340324e7-17ea-494c-be8f-764631958e2f for instance 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 on hv-cinder-82662 Jan 28 01:28:27.174794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-c67e49cc-b427-46e8-b9c2-94d7dd11ce78 req-5e9ef504-d3a7-4c23-a4f7-c4e345daf9a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083828 Jan 28 01:28:27.175973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 272/530] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:27.269583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:27.271134 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:27.282315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.283443 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:27.285151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.286285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:27.548993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:27.562708 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-14226d08-74ac-4dac-9189-05f432fbc392 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.297650 Jan 28 01:28:27.563853 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 259/531] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:27 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:27.590520 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:27.591509 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:27.601535 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.602458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:27.603326 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.603896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:27.822364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:27.833266 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:27.835049 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:27.836767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c61f1dda-4649-4987-ae19-77725cf7aef7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1718 microversion: 2.20 time: 0.254213 Jan 28 01:28:27.838215 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 273/532] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:27 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:27.958512 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:27.959133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:27.965672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.966121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:27.967004 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:27.967440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.052410 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-95a77b8f-210b-45d4-833b-764992d10ec1 req-1622d9d1-8dae-4d3d-a0cc-588a3b1368a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "name": "network-vif-unplugged", "status": "completed", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:28.055629 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:28.055629 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:28:28.065152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-95a77b8f-210b-45d4-833b-764992d10ec1 req-1622d9d1-8dae-4d3d-a0cc-588a3b1368a4 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.065647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-95a77b8f-210b-45d4-833b-764992d10ec1 req-1622d9d1-8dae-4d3d-a0cc-588a3b1368a4 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.087531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-95a77b8f-210b-45d4-833b-764992d10ec1 req-1622d9d1-8dae-4d3d-a0cc-588a3b1368a4 service nova] Creating event network-vif-unplugged:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:28:28.097584 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-95a77b8f-210b-45d4-833b-764992d10ec1 req-1622d9d1-8dae-4d3d-a0cc-588a3b1368a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051835 Jan 28 01:28:28.099399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 274/533] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:28.110687 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:28.112701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:28.123626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.124092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.124959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.125572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.151937 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] HTTP exception thrown: Instance 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 could not be found. Jan 28 01:28:28.152686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Returning 404 to user: Instance 7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:28.153589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0721e94e-ceb7-4cab-99d8-c19a6a68dd26 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4" status: 404 len: 111 microversion: 2.1 time: 0.052284 Jan 28 01:28:28.154169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 275/534] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:28 2022] GET /compute/v2.1/servers/7e0c8147-6b2d-4ca8-88db-0b80fe7cebe4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:28.162685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:28.163188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:28.175643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.176650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.178489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.179769 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.212795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:28.324432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1f37b17f-ba3d-462c-a376-1614adec0741 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 204 len: 0 microversion: 2.1 time: 0.165145 Jan 28 01:28:28.325366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 276/535] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:28 2022] DELETE /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 28 01:28:28.334305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:28.335475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:28.345255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.345713 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.346523 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.346951 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.468058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:28.477147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e6875f5c-9b36-4205-b66f-45faa5076b4a tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1508 microversion: 2.1 time: 0.522736 Jan 28 01:28:28.477792 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 260/536] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:27 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1508 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:28.544183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:28.551997 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4d748e44-9574-4767-86a3-9854a21354de tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1511 microversion: 2.1 time: 0.222406 Jan 28 01:28:28.552565 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 277/537] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:28 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:28.588049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:28.588526 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:28.603677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.604466 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.605939 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.606717 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.793497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:28.805265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-02de06d4-8cb2-4140-b223-52935c28c7e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.221257 Jan 28 01:28:28.806678 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 261/538] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:28 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:28.858593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:28.859889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:28.869482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.870255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:28.871525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:28.872244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.112921 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:29.122217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:29.124750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:29.126780 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7394a24a-5937-4cf1-9d12-cb8e283f340b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1721 microversion: 2.20 time: 0.274208 Jan 28 01:28:29.140351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 278/539] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:28 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:29.146271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17c2e3ad-1550-42bc-b9a4-b49ef531480b"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:29.147584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:29.154799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.155045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.155927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.156413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.213993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-c1c90886-e741-4520-a420-40a8b6ba6c80 req-19d202d8-4222-4967-9c32-1984984dfa26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127a036c-acd2-4297-82f5-1e41ca62c5bf", "tag": "441ae9b5-dea2-4a36-a88f-505954308634"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:29.215734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:29.215734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:28:29.222898 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-c1c90886-e741-4520-a420-40a8b6ba6c80 req-19d202d8-4222-4967-9c32-1984984dfa26 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.223424 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-c1c90886-e741-4520-a420-40a8b6ba6c80 req-19d202d8-4222-4967-9c32-1984984dfa26 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.240969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-c1c90886-e741-4520-a420-40a8b6ba6c80 req-19d202d8-4222-4967-9c32-1984984dfa26 service nova] Creating event network-changed:441ae9b5-dea2-4a36-a88f-505954308634 for instance 127a036c-acd2-4297-82f5-1e41ca62c5bf on hv-cinder-82662 Jan 28 01:28:29.248241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-c1c90886-e741-4520-a420-40a8b6ba6c80 req-19d202d8-4222-4967-9c32-1984984dfa26 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041103 Jan 28 01:28:29.249399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 279/540] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:29.501674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:29.502960 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:29.515121 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.516192 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.531858 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.535982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.590046 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7a8d526f-9a03-4009-b87e-c068b11c9105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.447575 Jan 28 01:28:29.592980 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 262/541] 10.222.0.16 () {62 vars in 1363 bytes} [Fri Jan 28 01:28:29 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments => generated 188 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:28:29.601209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:29.602579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:29.614021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.614831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.616622 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.617777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.697169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:29.713243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-56559cf6-1f36-4ab6-b2db-4a5dcf17b416 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 200 len: 1293 microversion: 2.1 time: 0.221212 Jan 28 01:28:29.714768 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 280/542] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:29 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:29.780969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:29.781716 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:29.790190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.790650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.791834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.792030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.912816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:29.923726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5a278486-9c65-4a4f-acdf-ffc60d7444fb tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1511 microversion: 2.1 time: 0.329016 Jan 28 01:28:29.924403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 263/543] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:29 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1511 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:29.929606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:29.931334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:29.938475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.938994 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.939791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.940233 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.946844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0e91f5c6-04cc-49a4-8d05-c95ecc3db3d2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action" status: 202 len: 0 microversion: 2.20 time: 0.171452 Jan 28 01:28:29.949396 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 281/544] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:28:29 2022] POST /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:29.957347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:29.959075 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:29.971985 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.972764 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:29.974252 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:29.975366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.290290 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:30.300603 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:30.302955 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-29cda80f-9d6d-48dd-ac88-f1beb773f5d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.376832 Jan 28 01:28:30.314068 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 264/545] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:29 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:30.314312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:30.314312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:30.315093 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cbe98779-1109-4ab9-a32c-1499ced1619b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1747 microversion: 2.20 time: 0.363008 Jan 28 01:28:30.316113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 282/546] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:29 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1747 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:30.731102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:30.731734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:30.737890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.738547 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.739600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.739995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.757165 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] HTTP exception thrown: Instance 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae could not be found. Jan 28 01:28:30.758565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Returning 404 to user: Instance 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:30.759320 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8623e3c8-4d5c-4ef6-824d-16a3215bec42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae" status: 404 len: 111 microversion: 2.1 time: 0.032395 Jan 28 01:28:30.760058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 265/547] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:30 2022] GET /compute/v2.1/servers/2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:30.768292 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:30.769116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:30.775966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.776429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.777206 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.777674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.803075 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:30.888932 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a1556348-2ebb-4f4c-8ccc-f7bfb703e70b tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 204 len: 0 microversion: 2.1 time: 0.123978 Jan 28 01:28:30.889698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 283/548] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:30 2022] DELETE /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:30.897984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:30.898645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:30.906897 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.907599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.908709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.909344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.942980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:30.945273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:30.952093 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.952573 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:30.953632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:30.954763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:31.223898 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:31.232942 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-201da5a5-0688-40df-aa38-0021c5f10514 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.338937 Jan 28 01:28:31.233663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 266/549] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:30 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:31.271404 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-3960aa2a-fc50-456f-9ced-210dac3f3885 req-361bdad9-f8c3-484c-8cf4-e405eb85add5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae", "name": "network-vif-deleted", "tag": "ea29b944-0e8c-4c3a-be50-a3fd52f71b74"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:31.273730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:31.273730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:31.284299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-3960aa2a-fc50-456f-9ced-210dac3f3885 req-361bdad9-f8c3-484c-8cf4-e405eb85add5 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:31.284914 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-3960aa2a-fc50-456f-9ced-210dac3f3885 req-361bdad9-f8c3-484c-8cf4-e405eb85add5 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:31.293360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:31.299705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-3960aa2a-fc50-456f-9ced-210dac3f3885 req-361bdad9-f8c3-484c-8cf4-e405eb85add5 service nova] Creating event network-vif-deleted:ea29b944-0e8c-4c3a-be50-a3fd52f71b74 for instance 2ec324b8-b81a-4f36-a3e4-e6118a0ef8ae on hv-cinder-82662 Jan 28 01:28:31.304254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-3960aa2a-fc50-456f-9ced-210dac3f3885 req-361bdad9-f8c3-484c-8cf4-e405eb85add5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039380 Jan 28 01:28:31.305513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 267/550] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:31.312208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9383cd12-f4b3-43f7-abf0-d58a17d26de2 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 200 len: 1511 microversion: 2.1 time: 0.373647 Jan 28 01:28:31.312816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 284/551] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:30 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 1511 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:31.333683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:31.334389 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:31.343087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:31.343727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:31.344516 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:31.344734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:31.344945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:31.345385 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:31.361039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:31.362456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:31.366561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:31.367304 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:31.592231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:31.604683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bc0b2a51-f183-4f84-8e23-9c2a4a3d40ea tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.276753 Jan 28 01:28:31.605726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 268/552] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:31 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:31.626692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:31.641554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:31.643786 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:31.645848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-10288cd6-9464-421f-b54c-6eb500af920c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1749 microversion: 2.20 time: 0.312698 Jan 28 01:28:31.646772 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 285/553] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:31 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1749 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:32.253315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:32.253859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:32.262638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.263394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.264624 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.265079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.334483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:32.335091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:32.343464 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.343900 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.344712 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.345151 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.363351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] HTTP exception thrown: Instance 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b could not be found. Jan 28 01:28:32.363848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Returning 404 to user: Instance 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:32.364743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8d690f63-9830-43d7-9a3c-6ebf53317494 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b" status: 404 len: 111 microversion: 2.1 time: 0.034406 Jan 28 01:28:32.365371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 286/554] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:32 2022] GET /compute/v2.1/servers/53f0c6ea-cf1e-4f40-a1df-34e3af551c5b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:32.452793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:32.465509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fdf41f85-f335-44fb-94c4-93a591c6f054 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.216487 Jan 28 01:28:32.466246 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 269/555] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:32 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:32.633857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:32.634648 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:32.641197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.641674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.642499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.642928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.677490 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:32.678260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:32.685428 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.685967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.686826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:32.687353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:32.949418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:32.956914 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:32.958251 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b177a226-768f-4dec-bf01-a03a45bdede9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.329552 Jan 28 01:28:32.959263 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 287/556] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:32 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:32.971253 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:32.972741 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:32.974019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-875f0a36-e415-4d0b-a9c2-0d16a39e487a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.301537 Jan 28 01:28:32.974603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 270/557] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:32 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:33.338924 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-04061f1b-039c-4d18-9154-468388cc3d89 req-74c681b0-5d1f-4f10-9b8c-8908330e0118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53f0c6ea-cf1e-4f40-a1df-34e3af551c5b", "name": "network-vif-deleted", "tag": "0e97ac21-e6bf-4b16-a3c8-ceaa8e7b4c55"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:33.340587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:33.340587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:28:33.348605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-04061f1b-039c-4d18-9154-468388cc3d89 req-74c681b0-5d1f-4f10-9b8c-8908330e0118 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.349707 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-04061f1b-039c-4d18-9154-468388cc3d89 req-74c681b0-5d1f-4f10-9b8c-8908330e0118 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.362197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-04061f1b-039c-4d18-9154-468388cc3d89 req-74c681b0-5d1f-4f10-9b8c-8908330e0118 service nova] Creating event network-vif-deleted:0e97ac21-e6bf-4b16-a3c8-ceaa8e7b4c55 for instance 53f0c6ea-cf1e-4f40-a1df-34e3af551c5b on hv-cinder-82662 Jan 28 01:28:33.367336 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-04061f1b-039c-4d18-9154-468388cc3d89 req-74c681b0-5d1f-4f10-9b8c-8908330e0118 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Jan 28 01:28:33.368663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 288/558] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:33.487843 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:33.488595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:33.496163 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.496631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.497496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.498019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.533599 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:33.535663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:33.543329 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.543803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.544663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.545171 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.576105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:28:33.680135 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:33.682355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e88d9dc2-d6a3-4d30-a556-d1612131afa8 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "DELETE /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 204 len: 0 microversion: 2.1 time: 0.158209 Jan 28 01:28:33.682959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 289/559] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:28:33 2022] DELETE /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:28:33.692788 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b375a877-32c1-4c5f-abff-2eff6d09afc9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.209491 Jan 28 01:28:33.693578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 271/560] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:33 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:33.693741 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:33.694619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:33.702589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.703064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.703853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.704351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.880953 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:33.889905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1657b86d-afb0-4739-8e12-95ea7b8b2239 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.201749 Jan 28 01:28:33.897496 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 290/561] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:33 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:33.979643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:33.980411 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:33.989775 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.990245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.991146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:33.991573 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:33.995227 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:33.996115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:34.007849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:34.009587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:34.012312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:34.014149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:34.237408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:34.248058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-76b3ab98-10f2-4052-842b-7c8e83942e5f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.273801 Jan 28 01:28:34.259927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 272/562] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:33 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:34.269413 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:34.291118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:34.294325 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:34.296337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31cea9c2-347d-43d6-8fc3-822d75252962 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.306659 Jan 28 01:28:34.297410 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 291/563] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:33 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:34.711964 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:34.713649 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:34.720951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:34.721616 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:34.722579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:34.723168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:34.899642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:34.909766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c421095c-ba40-4a29-9a03-7da1ee6a2a80 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.202971 Jan 28 01:28:34.910343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 273/564] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:34 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:34.916329 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:34.917194 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:34.925729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:34.926184 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:34.926981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:34.927414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:35.107093 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:35.121068 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-035fd492-f374-478a-9d7c-6111574ffa90 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.211711 Jan 28 01:28:35.122539 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 292/565] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:34 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:35.266224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:35.266834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:35.273259 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:35.273838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:35.274643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:35.275077 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:35.324857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:35.325525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:35.337177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:35.337177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:35.337177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:35.337177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:35.485581 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:35.498207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bcbfffa4-1ee8-4e15-92e5-b357cc709312 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.235255 Jan 28 01:28:35.499808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 274/566] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:35 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:35.561335 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:35.573550 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:35.576379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:35.578500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b31ddc07-0ea8-4303-ba75-ada1cf9f6201 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.259491 Jan 28 01:28:35.579426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 293/567] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:35 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:35.930184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:35.931855 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:35.940724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:35.941588 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:35.942426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:35.942858 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.126353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:36.134677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-34f0b41d-aac2-4c30-bfe6-d36e1b2bb13c tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.210500 Jan 28 01:28:36.135265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 275/568] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:35 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:36.150170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:36.150887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:36.160781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:36.161342 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.162171 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:36.162598 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.343037 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:36.353714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c68dfc06-17c5-42a0-8a7f-f5e988a02ae6 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.212907 Jan 28 01:28:36.354305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 294/569] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:36 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:36.518700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:36.519436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:36.526379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:36.526834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.527656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:36.528092 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.599033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:36.599639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:36.615958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:36.615958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.615958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:36.615958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:36.755665 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:36.768083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-977d2a2b-eb54-438a-b07b-9608ccc78571 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.255038 Jan 28 01:28:36.769362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 276/570] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:36 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:36.831925 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:36.841810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:36.843624 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:36.844942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-90514e53-89cb-43e6-992e-b4bacf7370f2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.250045 Jan 28 01:28:36.845816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 295/571] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:36 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:37.152757 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:37.153571 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:37.161620 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.162069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.163268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.164432 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.322617 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:37.338612 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e012b0a6-7c45-435e-ba10-745ca1c88df9 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.189574 Jan 28 01:28:37.339210 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 277/572] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:37 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:37.374580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:37.376202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:37.384739 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.386175 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.387496 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.388095 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.540603 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:37.549606 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8e30a88f-8beb-4a7b-8fd4-2626726d9696 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.181465 Jan 28 01:28:37.559524 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 296/573] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:37 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:37.788303 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:37.788988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:37.797134 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.798166 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.799367 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.800011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.866147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:37.867243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:37.879288 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.880103 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:37.881115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:37.881896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:38.337768 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:38.351540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-98d8f70e-7390-46b7-aee0-a4e2f8b0524d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.568659 Jan 28 01:28:38.352591 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 278/574] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:37 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:38.363208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:38.366115 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:38.367029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:38.373827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:38.374098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:38.374474 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:38.375496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:38.375922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:38.383273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:38.388259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8403b173-c0ed-4b32-a31e-7de3a8e3953c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.525892 Jan 28 01:28:38.389476 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 297/575] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:37 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:38.536289 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:38.544435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-18bfdd9e-2e07-4a57-b207-a0bf64b4e6a5 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.190315 Jan 28 01:28:38.545013 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 279/576] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:38 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:38.569965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:38.571115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:38.581121 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:38.581892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:38.583091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:38.583537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:38.779088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:38.787712 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f03e8a12-f2a7-4b2e-bee9-2a39f31231d4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.224102 Jan 28 01:28:38.788499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 298/577] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:38 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:39.369511 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:39.374336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:39.386934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.387616 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.389511 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.389881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.412919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:39.414836 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:39.427347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.428233 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.429463 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.430020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.647095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:39.659641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-426a6dc5-ca1d-4d13-b741-1e30eac9dfe6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.294242 Jan 28 01:28:39.660236 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 280/578] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:39 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:39.675329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:39.675329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:39.680767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.681206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.682017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.682441 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.696056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:39.714776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:39.718073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:39.720191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bd92a3e3-88ef-42dd-b7ef-ff9473e50833 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.313001 Jan 28 01:28:39.721278 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 299/579] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:39 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:39.810852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:39.811927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:39.825444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.826762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.828423 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:39.829416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:39.875689 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:39.884253 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-58c03203-fad8-4c7f-8ba4-ed25e76ebeda tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.222865 Jan 28 01:28:39.886357 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 281/580] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:39 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:40.025844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:40.034158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-23165605-64cf-431b-8c39-9ada561589cd tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.231033 Jan 28 01:28:40.034979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 300/581] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:39 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:40.676491 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:40.677161 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:40.684201 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:40.684641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:40.685551 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:40.685962 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:40.740485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:40.741507 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:40.749426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:40.749845 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:40.750642 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:40.751067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:40.952083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:40.960259 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-857ac9ef-33ae-49e5-8920-c628c96b8f5b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.287401 Jan 28 01:28:40.969898 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 282/582] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:40 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:40.975074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:40.975780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:40.982244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:40.982780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:40.983651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:40.984151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:41.008002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:41.019531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:41.021568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:41.023610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9be4f4ca-a809-414e-9738-ed51b3da7c7d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.286871 Jan 28 01:28:41.029268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 301/583] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:40 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:41.060034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:41.060769 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:41.067247 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:41.067785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:41.068656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:41.069154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:41.200466 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:41.208864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-030e126e-b2ec-4172-b7ad-e4d5e5124a42 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.237589 Jan 28 01:28:41.209666 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 283/584] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:40 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:41.265400 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:41.286154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e6a55c00-15c6-410e-98d6-7560602ff5f4 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.230228 Jan 28 01:28:41.287186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 302/585] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:41 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:41.977664 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:41.979949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:41.985312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:41.985566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:41.986827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:41.986827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.043432 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:42.044217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:42.051675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:42.052154 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.052973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:42.053428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.183442 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:42.195043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3ce68f3e-9534-4416-a1d8-0d2590eb7f5e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.221443 Jan 28 01:28:42.197000 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 284/586] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:41 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:42.232710 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:42.233936 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:42.242890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:42.243354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.244472 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:42.244929 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.245672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:42.255848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:42.257697 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:42.258888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-19976a2e-735a-4095-84e9-f356b74849b2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.219901 Jan 28 01:28:42.270381 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 303/587] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:42 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:42.303803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:42.304618 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:42.311471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:42.312019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.312904 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:42.313458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:42.473728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:42.482380 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-13f43540-821d-40e2-ab86-d0543f6926e1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.258410 Jan 28 01:28:42.483537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 285/588] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:42 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:42.527103 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:42.535781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-302fcc55-a1de-4ee6-91bc-684533607435 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.235670 Jan 28 01:28:42.536406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 304/589] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:42 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:43.214440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:43.215442 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:43.221712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.222157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.222937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.223366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.277748 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:43.278449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:43.285447 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.285885 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.286681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.287115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.427838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:43.438372 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5fbb915b-9db9-4042-93c2-e5c65cafdcb2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.227433 Jan 28 01:28:43.439437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 286/590] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:43 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:43.487253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:43.500362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:43.501888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:43.502903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:43.503095 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-039dc9ae-d5cf-4038-aec1-2529acf935f7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.229284 Jan 28 01:28:43.503513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:43.509959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.510397 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.511218 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.511681 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.513918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 305/591] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:43 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:43.556009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:43.557110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:43.566852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.567667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.569022 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:43.569823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:43.745594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:43.759059 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-769165e2-0515-44f1-8418-1d837058c044 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.261353 Jan 28 01:28:43.759992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 287/592] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:43 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:43.816992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:43.826166 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b7cfaaaf-aae6-4b61-8aed-a1eab15999dc tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.275787 Jan 28 01:28:43.826763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 306/593] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:43 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:44.459933 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:44.460530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:44.467805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.468330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.469206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.469733 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.526166 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:44.526854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:44.538121 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.538563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.539388 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.539809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.672109 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:44.680777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-502fae67-0f16-4e5e-918f-f7a16aae18aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.224418 Jan 28 01:28:44.681605 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 288/594] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:44 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:44.731698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:44.740744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:44.742289 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:44.743601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8516650a-5082-4704-ac15-2dcd49ce9aec tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.226017 Jan 28 01:28:44.744267 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 307/595] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:44 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:44.780851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:44.781990 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:44.790248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.790685 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.791478 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.791906 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.844053 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:44.844654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:44.850781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.851207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.852058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:44.852482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:44.988349 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:44.996597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d924a5eb-799e-472e-b316-b4895674bb52 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.220995 Jan 28 01:28:44.997180 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 289/596] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:44 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:45.075411 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:45.083676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-431fc85d-1f97-4399-9b09-b4bdb28f7040 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1511 microversion: 2.1 time: 0.243416 Jan 28 01:28:45.084361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 308/597] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:44 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:45.512309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-23cf25d0-4638-4b59-95ed-81890b2df4ad req-c1196333-8290-4bbc-b1ac-d9fad47e6e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92a6de0f-2d0d-4667-aa75-cdfa602b2385", "name": "network-vif-deleted", "tag": "59cce6ec-860d-4d1c-bf82-0e624e2e27cb"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:45.514731 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:45.514731 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:45.523671 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-23cf25d0-4638-4b59-95ed-81890b2df4ad req-c1196333-8290-4bbc-b1ac-d9fad47e6e74 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:45.523978 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-23cf25d0-4638-4b59-95ed-81890b2df4ad req-c1196333-8290-4bbc-b1ac-d9fad47e6e74 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:45.541722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-23cf25d0-4638-4b59-95ed-81890b2df4ad req-c1196333-8290-4bbc-b1ac-d9fad47e6e74 service nova] Creating event network-vif-deleted:59cce6ec-860d-4d1c-bf82-0e624e2e27cb for instance 92a6de0f-2d0d-4667-aa75-cdfa602b2385 on hv-cinder-82662 Jan 28 01:28:45.553220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-23cf25d0-4638-4b59-95ed-81890b2df4ad req-c1196333-8290-4bbc-b1ac-d9fad47e6e74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044772 Jan 28 01:28:45.553798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 290/598] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:45.697673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:45.698284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:45.706307 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:45.707105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:45.707898 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:45.709563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:45.764518 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:45.765677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:45.774972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:45.775343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:45.776134 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:45.776561 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:45.890854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:45.903499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f800d514-0045-4809-aba7-eb9003c5dac0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.209449 Jan 28 01:28:45.904471 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 309/599] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:45 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:45.975244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:45.984031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:45.985536 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:45.986695 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6b3e0bfd-4056-45f3-bec9-597b706e37e0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.227525 Jan 28 01:28:45.987248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 291/600] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:45 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:46.013922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:46.015146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:46.021515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.021965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:46.022766 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.023186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:46.109602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:46.110563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:46.119248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.120239 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:46.121481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.122028 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:46.182811 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.183594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:46.185042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lazy-loading 'fault' on Instance uuid 92a6de0f-2d0d-4667-aa75-cdfa602b2385 {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:28:46.246602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:46.249314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdd86efb97ad48a994f04304a8459e54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945f13b911d24a89a9d374a503d05cbb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:46.255025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-70178606-d4ce-4365-badc-ac05a5c32544 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.245132 Jan 28 01:28:46.255922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 310/601] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:46 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:46.260501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-80610c73-ce4a-4f12-bed5-81ab4a1aa8a3 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 200 len: 1308 microversion: 2.1 time: 0.155669 Jan 28 01:28:46.262321 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 292/602] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:46 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 1308 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:46.923641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:46.924271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:46.931147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.931604 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:46.932392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:46.932825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.006017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:47.006673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:47.018426 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:47.019157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.020460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:47.021178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.077872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:47.088063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-111d839e-2b04-4adf-88e2-6fbadd06689e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.167989 Jan 28 01:28:47.088671 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 311/603] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:46 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:47.188274 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:47.197458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:47.199009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:47.200209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-90eb4fa4-5a1e-436e-9600-0bbe5da9e29c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.198834 Jan 28 01:28:47.200965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 293/604] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:47 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:47.277018 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:47.277719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:47.283550 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:47.283887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:47.284155 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] [instance: 92a6de0f-2d0d-4667-aa75-cdfa602b2385] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:47.284303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.285088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:47.285554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.290808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:47.291252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.292035 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:47.292439 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:47.306256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] HTTP exception thrown: Instance 92a6de0f-2d0d-4667-aa75-cdfa602b2385 could not be found. Jan 28 01:28:47.306818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] Returning 404 to user: Instance 92a6de0f-2d0d-4667-aa75-cdfa602b2385 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:47.307646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0369d9b4-0f64-4be2-8367-cba54e9e41b7 tempest-AttachVolumeNegativeTest-786777331 tempest-AttachVolumeNegativeTest-786777331-project] 10.222.0.16 "GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385" status: 404 len: 111 microversion: 2.1 time: 0.027759 Jan 28 01:28:47.311917 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 294/605] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:47 2022] GET /compute/v2.1/servers/92a6de0f-2d0d-4667-aa75-cdfa602b2385 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:28:47.615818 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:47.624364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-942cc999-ac6b-4bf7-86af-3d01eb418ff7 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1521 microversion: 2.1 time: 0.351574 Jan 28 01:28:47.633616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 312/606] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:47 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:48.071281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-89edcb50-0c0e-4680-a8cd-046f9ac2d029 req-6b7d168d-4e4f-4f3a-8a89-28a106805405 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96d2486b-d99e-4c1b-b15e-173a27da5960", "name": "network-vif-deleted", "tag": "3399ad7b-0a30-47fc-87d4-cf5cc2205cf5"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:48.073979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:48.073979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:48.084725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-89edcb50-0c0e-4680-a8cd-046f9ac2d029 req-6b7d168d-4e4f-4f3a-8a89-28a106805405 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.085474 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-89edcb50-0c0e-4680-a8cd-046f9ac2d029 req-6b7d168d-4e4f-4f3a-8a89-28a106805405 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.099095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-89edcb50-0c0e-4680-a8cd-046f9ac2d029 req-6b7d168d-4e4f-4f3a-8a89-28a106805405 service nova] Creating event network-vif-deleted:3399ad7b-0a30-47fc-87d4-cf5cc2205cf5 for instance 96d2486b-d99e-4c1b-b15e-173a27da5960 on hv-cinder-82662 Jan 28 01:28:48.104620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:48.105362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:48.106245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-89edcb50-0c0e-4680-a8cd-046f9ac2d029 req-6b7d168d-4e4f-4f3a-8a89-28a106805405 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038312 Jan 28 01:28:48.107419 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 295/607] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:48.113789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-ee2a514d-8891-49b6-a1ce-b7c987901c23 req-1de1a3c0-cd40-4321-82b1-f4010e3836ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127a036c-acd2-4297-82f5-1e41ca62c5bf", "name": "network-vif-plugged", "status": "completed", "tag": "441ae9b5-dea2-4a36-a88f-505954308634"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:48.115923 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:48.115923 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:48.118168 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.118665 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.119532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.120435 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.124868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ee2a514d-8891-49b6-a1ce-b7c987901c23 req-1de1a3c0-cd40-4321-82b1-f4010e3836ac service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.125385 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ee2a514d-8891-49b6-a1ce-b7c987901c23 req-1de1a3c0-cd40-4321-82b1-f4010e3836ac service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.139607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-ee2a514d-8891-49b6-a1ce-b7c987901c23 req-1de1a3c0-cd40-4321-82b1-f4010e3836ac service nova] Creating event network-vif-plugged:441ae9b5-dea2-4a36-a88f-505954308634 for instance 127a036c-acd2-4297-82f5-1e41ca62c5bf on hv-cinder-82662 Jan 28 01:28:48.144700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-ee2a514d-8891-49b6-a1ce-b7c987901c23 req-1de1a3c0-cd40-4321-82b1-f4010e3836ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035579 Jan 28 01:28:48.145656 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 296/608] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:48.229953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:48.234631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:48.249945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.250668 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.251723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.252342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.314240 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:48.324128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bf8e7791-54f2-4c67-9e64-6c13d78ce674 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.222486 Jan 28 01:28:48.336684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 313/609] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:48 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:48.444074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:48.455050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:48.457643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:48.458823 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ad491aba-fd4d-452a-833b-1980060ed8be tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.234725 Jan 28 01:28:48.459659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 297/610] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:48 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:48.640724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:48.641389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:48.647474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.647936 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.649479 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.649832 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.688616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:48.689064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:48.689553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lazy-loading 'fault' on Instance uuid 96d2486b-d99e-4c1b-b15e-173a27da5960 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:28:48.731482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bc86d41bb2d4509913630ca774b4082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5a4cb240dac42849a9790a68eda072a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:48.739531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-01f7732f-3f64-4bbe-b9d9-3799381579b1 tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 200 len: 1312 microversion: 2.1 time: 0.102524 Jan 28 01:28:48.740435 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 314/611] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:48 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:49.343852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:49.344521 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:49.352436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:49.353060 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:49.353906 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:49.354344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:49.481980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:49.482928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:49.493026 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:49.494047 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:49.495458 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:49.496330 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:49.515693 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:49.528307 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-983085bf-fd7a-4804-ba19-918ae0db0d7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1265 microversion: 2.1 time: 0.187561 Jan 28 01:28:49.529351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 298/612] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:49 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:49.668822 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:49.679101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:49.681050 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:49.682286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2704cb17-d4a7-4d76-9535-3406f4645efc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.207110 Jan 28 01:28:49.682859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 315/613] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:49 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:49.757339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:49.758191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] [instance: 96d2486b-d99e-4c1b-b15e-173a27da5960] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:49.771422 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:49.772008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:49.773446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:49.774347 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:49.797979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] HTTP exception thrown: Instance 96d2486b-d99e-4c1b-b15e-173a27da5960 could not be found. Jan 28 01:28:49.799042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] Returning 404 to user: Instance 96d2486b-d99e-4c1b-b15e-173a27da5960 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:28:49.800522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-874d234d-68e6-4b7b-87f8-e2684e0cf0da tempest-ServerRescueNegativeTestJSON-1997775963 tempest-ServerRescueNegativeTestJSON-1997775963-project] 10.222.0.16 "GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960" status: 404 len: 111 microversion: 2.1 time: 0.046833 Jan 28 01:28:49.801530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 299/614] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:49 2022] GET /compute/v2.1/servers/96d2486b-d99e-4c1b-b15e-173a27da5960 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:28:50.551823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:50.552838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:50.559998 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:50.560680 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:50.561817 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:50.562334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:50.708410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:50.709099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:50.716014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:50.716547 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:50.717739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:50.718201 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:50.857566 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:50.865149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6b73bee8-cb55-4a2a-bbd8-e0758e2b4753 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1451 microversion: 2.1 time: 0.316950 Jan 28 01:28:50.866034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 316/615] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:50 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1451 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:28:50.881776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:50.882306 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:50.888538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:50.888988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:50.889899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:50.890335 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:50.984813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:50.994463 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:50.996126 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:50.997421 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4974e512-4173-4e58-a070-505270c8fc1b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.293350 Jan 28 01:28:51.008463 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 300/616] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:50 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:51.126145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:51.134212 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8f3f6e4f-a2ed-443d-8823-8eadc6b09f85 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1451 microversion: 2.1 time: 0.255949 Jan 28 01:28:51.134714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 317/617] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:28:50 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1451 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:28:52.015139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:52.015728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:52.024126 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:52.025484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:52.027109 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:52.029720 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:52.364092 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:52.373279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:52.380199 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:52.385262 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cac7a3d0-ba67-4fb6-abba-160697c260a1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.374135 Jan 28 01:28:52.388611 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 301/618] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:52 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:53.407242 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:53.408397 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:53.416020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:53.417069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:53.418381 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:53.429736 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:53.630791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-85bfc2f9-ef4f-43c0-907c-96721179fdea req-c9ce4d79-8013-4c8c-9c35-b447794d06ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127a036c-acd2-4297-82f5-1e41ca62c5bf", "tag": "441ae9b5-dea2-4a36-a88f-505954308634"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:53.633131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:53.633131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:53.642545 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-85bfc2f9-ef4f-43c0-907c-96721179fdea req-c9ce4d79-8013-4c8c-9c35-b447794d06ef service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:53.643261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-85bfc2f9-ef4f-43c0-907c-96721179fdea req-c9ce4d79-8013-4c8c-9c35-b447794d06ef service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:53.658234 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-85bfc2f9-ef4f-43c0-907c-96721179fdea req-c9ce4d79-8013-4c8c-9c35-b447794d06ef service nova] Creating event network-changed:441ae9b5-dea2-4a36-a88f-505954308634 for instance 127a036c-acd2-4297-82f5-1e41ca62c5bf on hv-cinder-82662 Jan 28 01:28:53.664613 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-85bfc2f9-ef4f-43c0-907c-96721179fdea req-c9ce4d79-8013-4c8c-9c35-b447794d06ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039492 Jan 28 01:28:53.666231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 302/619] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:28:53.790484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:53.805355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:53.831341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:53.835594 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6aa626bb-d820-47e1-8da5-b30d5feba198 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.430633 Jan 28 01:28:53.851456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 318/620] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:53 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:54.303373 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-59e0dec1-8a86-4946-bfd0-c2407d370741 req-2ae96f34-5bd6-4595-bfa8-f69e19074d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "name": "network-vif-plugged", "status": "completed", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:28:54.305056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:28:54.305056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:28:54.323019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-59e0dec1-8a86-4946-bfd0-c2407d370741 req-2ae96f34-5bd6-4595-bfa8-f69e19074d41 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:54.325302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-59e0dec1-8a86-4946-bfd0-c2407d370741 req-2ae96f34-5bd6-4595-bfa8-f69e19074d41 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:54.341979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-59e0dec1-8a86-4946-bfd0-c2407d370741 req-2ae96f34-5bd6-4595-bfa8-f69e19074d41 service nova] Creating event network-vif-plugged:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:28:54.351543 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-59e0dec1-8a86-4946-bfd0-c2407d370741 req-2ae96f34-5bd6-4595-bfa8-f69e19074d41 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051312 Jan 28 01:28:54.352748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 303/621] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:28:54.855986 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:54.856605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:54.866888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:54.867650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:54.868632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:54.869455 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:55.195680 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:55.225543 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:55.229008 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:55.231169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2e3a1cfc-ed8a-45ac-8403-302199d2b680 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.380150 Jan 28 01:28:55.246452 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 319/622] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:54 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:56.254115 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:56.254982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:56.261573 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:56.262013 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:56.262986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:56.263422 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:56.570250 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:56.584726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:56.595813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:56.598568 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-68fcfd4e-2016-44fe-97f2-719253f8f262 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.351203 Jan 28 01:28:56.610290 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 304/623] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:56 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:28:57.623917 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:57.624696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:57.640578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:57.641039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:57.641871 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:57.642286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:57.913178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:57.922995 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:57.924664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:57.926004 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e5265f1a-2f23-4392-9748-c4afcb3b13b9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1805 microversion: 2.20 time: 0.306185 Jan 28 01:28:57.926923 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 320/624] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:57 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1805 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:28:58.946763 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:28:58.949540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:28:58.963146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:58.963865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:58.965371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:28:58.966020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:28:59.196320 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:59.212294 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:59.214455 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:28:59.216919 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c0658810-404e-460c-aeb2-b4e998122861 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1792 microversion: 2.20 time: 0.275338 Jan 28 01:28:59.217515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 305/625] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:28:58 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1792 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:29:01.153737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-58b9e8bf-cdfb-424f-b329-9d965a62f1dc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: .version_select at 0x7f7e7767b700>, body: {"keypair": {"name": "tempest-keypair-1392840431"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:01.176762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-58b9e8bf-cdfb-424f-b329-9d965a62f1dc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:01.181097 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-58b9e8bf-cdfb-424f-b329-9d965a62f1dc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for user f02cd9096152479da885ead20d3ec061 and project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:01.306360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-58b9e8bf-cdfb-424f-b329-9d965a62f1dc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:01.311360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-58b9e8bf-cdfb-424f-b329-9d965a62f1dc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for user f02cd9096152479da885ead20d3ec061 and project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:01.327207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-58b9e8bf-cdfb-424f-b329-9d965a62f1dc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.466771 Jan 28 01:29:01.327821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 321/626] 10.222.0.16 () {60 vars in 1157 bytes} [Fri Jan 28 01:29:00 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:02.962099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1196169050", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cd1bdde-3b03-46ba-9a57-34554b07975c"}], "security_groups": [{"name": "tempest-securitygroup--476149019"}], "key_name": "tempest-keypair-1392840431", "user_data": "}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:03.092561 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] validate_networks() for [('4cd1bdde-3b03-46ba-9a57-34554b07975c', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:29:03.569110 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:29:03.569549 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:29:03.570941 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:29:03.570941 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:29:03.571373 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:29:03.582236 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:03.582680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:03.583480 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:03.583908 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:03.601846 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for project 0639b703e727474d8b71d24f7709a813. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:03.606209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for user f02cd9096152479da885ead20d3ec061 and project 0639b703e727474d8b71d24f7709a813. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:03.631149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:29:03.633873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:29:03.706666 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ca72b11f-a1f6-41f3-9e87-0a5afac7c6f1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.748926 Jan 28 01:29:03.708773 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 306/627] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:29:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:29:03.717749 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5181be5e-7410-427b-adc0-7fba0c1a3283 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:03.719115 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5181be5e-7410-427b-adc0-7fba0c1a3283 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:03.783061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5181be5e-7410-427b-adc0-7fba0c1a3283 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:03.790188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5181be5e-7410-427b-adc0-7fba0c1a3283 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1238 microversion: 2.1 time: 0.076062 Jan 28 01:29:03.791078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 322/628] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:03 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:29:04.814979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:04.815851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:04.826144 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:04.826983 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:04.828359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:04.829409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:04.936603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:04.953352 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f5a6dc81-7e83-40f7-aa9e-75cb1bc1d6e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1290 microversion: 2.1 time: 0.148334 Jan 28 01:29:04.955261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 307/629] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:04 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:05.973762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:05.974997 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:05.984301 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:05.987711 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:05.995609 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:05.997461 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:06.107415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:06.116025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5ad5be98-0886-4713-8df0-d26f4a56a3f9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1296 microversion: 2.1 time: 0.145948 Jan 28 01:29:06.116588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 323/630] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:05 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:07.137312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:07.139297 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:07.148596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:07.149387 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:07.150714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:07.151505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:07.389021 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-8ae73d43-9e08-4a8b-bdb2-bdc8f3f8f8a5 req-8c4a1c23-534f-4311-9e5a-680c7b4511bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b5cb18-2b39-4a8d-9832-43a930270995", "tag": "187a7e7e-fa5e-4e14-a711-a70e8a3165d3"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:07.392445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:29:07.392445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:29:07.409503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-8ae73d43-9e08-4a8b-bdb2-bdc8f3f8f8a5 req-8c4a1c23-534f-4311-9e5a-680c7b4511bc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:07.410289 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-8ae73d43-9e08-4a8b-bdb2-bdc8f3f8f8a5 req-8c4a1c23-534f-4311-9e5a-680c7b4511bc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:07.428008 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-8ae73d43-9e08-4a8b-bdb2-bdc8f3f8f8a5 req-8c4a1c23-534f-4311-9e5a-680c7b4511bc service nova] Creating event network-changed:187a7e7e-fa5e-4e14-a711-a70e8a3165d3 for instance 66b5cb18-2b39-4a8d-9832-43a930270995 on hv-cinder-82662 Jan 28 01:29:07.433698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-8ae73d43-9e08-4a8b-bdb2-bdc8f3f8f8a5 req-8c4a1c23-534f-4311-9e5a-680c7b4511bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049831 Jan 28 01:29:07.435120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 324/631] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:29:07.457410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:07.471742 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d248c243-9fc6-4142-afad-6f450a754185 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.340325 Jan 28 01:29:07.472942 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 308/632] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:07 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:08.500641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:08.501500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:08.508072 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:08.508653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:08.509658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:08.510809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:08.730758 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:08.741502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a712ef8b-437c-4d1d-8ea8-046649e2fa3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.247255 Jan 28 01:29:08.741721 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 325/633] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:08 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:09.759243 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:09.759974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:09.768812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:09.769279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:09.770106 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:09.771012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:09.923654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:09.931623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-742da5d6-0de8-4693-8d07-1e6331b7add8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.177623 Jan 28 01:29:09.932309 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 309/634] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:09 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:10.948645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:10.949481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:10.957087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:10.957569 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:10.958366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:10.958804 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:11.109794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:11.119300 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-abb975e2-48ee-4f66-9cc7-2ef6a65f08de tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.174131 Jan 28 01:29:11.120532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 326/635] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:10 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:12.142021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:12.142621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:12.149786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:12.150246 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:12.151045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:12.151485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:12.322123 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:12.330413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-da66625d-2034-4030-993d-12436dcceeb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.191626 Jan 28 01:29:12.330989 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 310/636] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:12 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:13.347961 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:13.348564 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:13.356073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:13.356627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:13.357502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:13.358201 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:13.748016 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:13.757833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-871ed960-0d09-4e64-8433-ae6315502a0d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.413540 Jan 28 01:29:13.758408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 327/637] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:13 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:14.182048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-83a6f501-6f59-4b52-8f60-3ec8a4cb2474 req-18814a88-fe7c-41bd-a2b6-77c38863fe20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b5cb18-2b39-4a8d-9832-43a930270995", "name": "network-vif-plugged", "status": "completed", "tag": "187a7e7e-fa5e-4e14-a711-a70e8a3165d3"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:14.183785 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:29:14.183785 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:29:14.191485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-83a6f501-6f59-4b52-8f60-3ec8a4cb2474 req-18814a88-fe7c-41bd-a2b6-77c38863fe20 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:14.191921 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-83a6f501-6f59-4b52-8f60-3ec8a4cb2474 req-18814a88-fe7c-41bd-a2b6-77c38863fe20 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:14.205257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-83a6f501-6f59-4b52-8f60-3ec8a4cb2474 req-18814a88-fe7c-41bd-a2b6-77c38863fe20 service nova] Creating event network-vif-plugged:187a7e7e-fa5e-4e14-a711-a70e8a3165d3 for instance 66b5cb18-2b39-4a8d-9832-43a930270995 on hv-cinder-82662 Jan 28 01:29:14.210517 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-83a6f501-6f59-4b52-8f60-3ec8a4cb2474 req-18814a88-fe7c-41bd-a2b6-77c38863fe20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032329 Jan 28 01:29:14.211133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 311/638] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:29:14.783134 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:14.783767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:14.790771 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:14.791225 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:14.792024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:14.792612 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:14.935152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:14.943489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-19f36b76-5a0a-4168-80c9-204ca3ccac5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1363 microversion: 2.1 time: 0.166847 Jan 28 01:29:14.944083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 328/639] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:14 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:15.963111 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:15.964589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:15.973584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:15.974463 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:15.975814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:15.976574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:16.135420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:16.148339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8aac45ba-dcf3-4ea2-bbc0-c0d2a553ecbd tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1550 microversion: 2.1 time: 0.189578 Jan 28 01:29:16.149200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 312/640] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:15 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:29:16.172335 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:16.173274 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:16.180144 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:16.180757 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:16.181758 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:16.182340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:16.292213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6a0aebb0-e477-46f5-9ca3-da938f1134d4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124103 Jan 28 01:29:16.292981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 329/641] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jan 28 01:29:16 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:29:17.641344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:17.642259 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:17.652118 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-9ec0b0b9-8da4-4572-8c16-2cb3ef90e5ac req-b38cf4c7-bc8f-4603-a37d-3a16157432c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66b5cb18-2b39-4a8d-9832-43a930270995", "tag": "187a7e7e-fa5e-4e14-a711-a70e8a3165d3"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:17.653709 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:29:17.653709 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:29:17.659483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:17.659933 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:17.660740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:17.661177 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:17.671341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-9ec0b0b9-8da4-4572-8c16-2cb3ef90e5ac req-b38cf4c7-bc8f-4603-a37d-3a16157432c2 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:17.671795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-9ec0b0b9-8da4-4572-8c16-2cb3ef90e5ac req-b38cf4c7-bc8f-4603-a37d-3a16157432c2 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:17.684468 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-9ec0b0b9-8da4-4572-8c16-2cb3ef90e5ac req-b38cf4c7-bc8f-4603-a37d-3a16157432c2 service nova] Creating event network-changed:187a7e7e-fa5e-4e14-a711-a70e8a3165d3 for instance 66b5cb18-2b39-4a8d-9832-43a930270995 on hv-cinder-82662 Jan 28 01:29:17.692765 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-9ec0b0b9-8da4-4572-8c16-2cb3ef90e5ac req-b38cf4c7-bc8f-4603-a37d-3a16157432c2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044497 Jan 28 01:29:17.693827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 330/642] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:29:17.805651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d7c3bfad-3034-4df8-bfb8-57a537026cbc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.167395 Jan 28 01:29:17.806984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 313/643] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:17 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:18.820168 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:18.821273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:18.828264 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:18.828872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:18.830102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:18.830728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:18.928719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-553a3ba8-16d1-45b1-aa9f-94484297d6bc tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.112381 Jan 28 01:29:18.929602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 331/644] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:18 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:19.941096 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:19.942131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:19.949533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:19.949990 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:19.950772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:19.951193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:20.056154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2d627666-9634-4ec0-ab79-ed2378512ce3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.118994 Jan 28 01:29:20.056799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 314/645] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:19 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:21.070588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:21.071282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:21.078697 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:21.079025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:21.080259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:21.080787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:21.188841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2863513f-295d-4073-a4c5-bc30f32c533d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.122957 Jan 28 01:29:21.192623 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 332/646] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:21 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:22.202197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:22.203211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:22.211128 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:22.211575 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:22.212366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:22.212796 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:22.319251 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f608142a-90a4-4b06-9aad-4f5c97e03cee tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.120539 Jan 28 01:29:22.323009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 315/647] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:22 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:23.332136 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:23.333172 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:23.341560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:23.342080 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:23.343563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:23.343790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:23.437937 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c45b6345-eb25-4c14-9c74-baed7e6f194b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.110239 Jan 28 01:29:23.438578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 333/648] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:23 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:24.450327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:24.451335 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:24.459641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:24.460090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:24.460894 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:24.461360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:26.954134 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b8cd19b4-768f-468b-88bc-f293f8f7c8ea tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 2.507955 Jan 28 01:29:26.955772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 316/649] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:24 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:27.966884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:27.967913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:27.975743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:27.976211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:27.977039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:27.977512 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:28.081806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e8dfb03d-9c31-4c1d-920c-c47b8605cbe6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 14 microversion: 2.1 time: 0.118645 Jan 28 01:29:28.083179 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 334/650] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:27 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:29:29.095003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:29.096235 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:29.106133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:29.106541 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:29.107445 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:29.107878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:31.331211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-16bb19ee-e8cc-4dec-bd15-60917938d5c0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 15025 microversion: 2.1 time: 2.240191 Jan 28 01:29:31.332054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 317/651] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:29 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 15025 bytes in 2242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:32.343867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:32.344775 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:32.352046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:32.352494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:32.353332 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:32.353769 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:32.484939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-52ccd697-a351-49bc-940b-9eb5b526f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 18083 microversion: 2.1 time: 0.145193 Jan 28 01:29:32.489527 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 335/652] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:32 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 18083 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:33.499054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:33.500150 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:33.508512 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:33.508953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:33.509758 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:33.510178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:33.606859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d1dce146-bfdb-4adb-97b7-4baa26260d10 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 19133 microversion: 2.1 time: 0.112247 Jan 28 01:29:33.608688 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 318/653] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:33 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 19133 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:34.621580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:34.622583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:34.630204 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:34.631082 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:34.631429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:34.631861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:34.732811 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e8864530-7d55-49df-a8ab-095cc81452c9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 20997 microversion: 2.1 time: 0.115190 Jan 28 01:29:34.733511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 336/654] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:34 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 20997 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:35.745773 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:35.746749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:35.754398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:35.754837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:35.755632 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:35.756058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:38.131684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8f9dd911-e572-4944-a6fb-353173091f22 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 24317 microversion: 2.1 time: 2.390068 Jan 28 01:29:38.132522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 319/655] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:35 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 24317 bytes in 2392 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:39.144375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:39.145314 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:39.154214 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:39.154660 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:39.155494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:39.155927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:39.272770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e474e0ea-cd25-404f-9c6f-e093d7046346 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 25309 microversion: 2.1 time: 0.132202 Jan 28 01:29:39.273676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 337/656] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:39 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 25309 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:40.286668 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:40.288063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:40.297744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:40.298191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:40.299037 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:40.299464 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:40.411117 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6fe5e4aa-cc78-4310-948a-0b1b5bd72d90 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 26313 microversion: 2.1 time: 0.128681 Jan 28 01:29:40.414292 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 320/657] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:40 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 26313 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:41.427066 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:41.428100 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:41.435796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:41.436257 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:41.437069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:41.437537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:41.546402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c05dd44d-34ef-44f8-8a00-4b96bf40d176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 27136 microversion: 2.1 time: 0.123561 Jan 28 01:29:41.547077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 338/658] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:41 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 27136 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:42.558589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:42.559627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:42.566893 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:42.567347 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:42.568212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:42.568684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:42.686520 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1f1b4a03-062f-47a5-a1bf-a6c397ab4680 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 27719 microversion: 2.1 time: 0.132141 Jan 28 01:29:42.690494 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 321/659] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:42 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 27719 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:43.699085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:43.700059 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:43.707260 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:43.707704 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:43.708487 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:43.708916 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:43.824503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3416540c-7fe9-49a5-883e-72943a76bd58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28141 microversion: 2.1 time: 0.129329 Jan 28 01:29:43.825321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 339/660] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:43 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28141 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:44.838022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:44.839034 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:44.846366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:44.846807 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:44.847587 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:44.848013 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:44.958812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b64b99b1-bb39-437d-804d-8ee3afd41f74 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28199 microversion: 2.1 time: 0.124796 Jan 28 01:29:44.959525 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 322/661] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:44 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28199 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:45.972720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:45.973865 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:45.981745 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:45.982368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:45.983207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:45.983691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:46.080476 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8f7c730e-934f-451e-bc24-5699ff35290a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28199 microversion: 2.1 time: 0.112282 Jan 28 01:29:46.081194 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 340/662] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:45 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28199 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:46.331341 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-186967605", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "f38edd44-ee68-4f04-b487-0fc08b20b6d9"}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:46.395109 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] validate_networks() for [('f38edd44-ee68-4f04-b487-0fc08b20b6d9', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:29:47.025998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:29:47.026418 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:29:47.026882 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:29:47.027283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:29:47.027679 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:29:47.041822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.042267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.043093 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.043524 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.061456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Getting quotas for project a1700ad15ae3467494fdcc80ffd1a648. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:47.066026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Getting quotas for user 65a9be47ecd648508ef952ebb42a300a and project a1700ad15ae3467494fdcc80ffd1a648. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:47.077601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:29:47.080479 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:29:47.092803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:47.093928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:47.101170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.101838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.102535 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.102967 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.126381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5972b76f-8d03-44b5-ad6c-6d4e2876a8ed tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799374 Jan 28 01:29:47.127230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 323/663] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:29:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:29:47.137022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-125d73e3-ba2d-4fea-aa90-0320463dbfa1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:47.137591 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-125d73e3-ba2d-4fea-aa90-0320463dbfa1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:47.193793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-125d73e3-ba2d-4fea-aa90-0320463dbfa1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:47.201094 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-125d73e3-ba2d-4fea-aa90-0320463dbfa1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1218 microversion: 2.1 time: 0.067754 Jan 28 01:29:47.211484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 324/664] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:47 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:29:47.216453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e1700a7e-ec31-4354-b6a5-2dbc32c81ed4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28490 microversion: 2.1 time: 0.127233 Jan 28 01:29:47.217222 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 341/665] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:47 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28490 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:29:47.469127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:47.470283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:47.477718 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.478091 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.478880 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.479314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.514988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1d375dca-d429-4101-a09c-a661430c6e66 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments/17c2e3ad-1550-42bc-b9a4-b49ef531480b" status: 200 len: 194 microversion: 2.20 time: 0.049686 Jan 28 01:29:47.515607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 325/666] 10.222.0.16 () {60 vars in 1453 bytes} [Fri Jan 28 01:29:47 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments/17c2e3ad-1550-42bc-b9a4-b49ef531480b => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:47.584595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:47.585444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:47.592595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.593104 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.593981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.594477 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.677976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lazy-loading 'services' on Instance uuid ee84016d-9001-4252-b16e-a4c1a7999a5a {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:29:47.756178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-35103d73-6959-49d1-af4c-382dacc5ef3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments/17c2e3ad-1550-42bc-b9a4-b49ef531480b" status: 202 len: 0 microversion: 2.20 time: 0.175626 Jan 28 01:29:47.756845 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 342/667] 10.222.0.16 () {60 vars in 1456 bytes} [Fri Jan 28 01:29:47 2022] DELETE /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments/17c2e3ad-1550-42bc-b9a4-b49ef531480b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:29:47.765571 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:47.766869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:47.774318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.774766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.775748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:47.776347 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:47.813327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-81907aa5-fd90-452e-b34b-d2370eab948c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051508 Jan 28 01:29:47.814206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 326/668] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jan 28 01:29:47 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:48.220542 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:48.221415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:48.230905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:48.232089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:48.233834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:48.234392 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:48.235230 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:48.235664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:48.238915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:48.239420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:48.240255 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:48.240709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:48.348032 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:48.356691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ec132cb2-c356-40df-b4ca-da9f930c3def tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1278 microversion: 2.1 time: 0.140283 Jan 28 01:29:48.356968 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 343/669] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:48 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1278 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:29:48.374348 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a445ba6a-a9c6-42cc-b63b-91ebea7a613c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28658 microversion: 2.1 time: 0.149580 Jan 28 01:29:48.375584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 327/670] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:48 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28658 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:48.825377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:48.826236 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:48.833399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:48.833859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:48.834663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:48.835226 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:48.869121 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a07eebbd-ccb2-4885-976d-7b3931352d4b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047255 Jan 28 01:29:48.869516 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 344/671] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jan 28 01:29:48 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:49.374883 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:49.375483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:49.382709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.383249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.384009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.384623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.387607 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:49.388513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:49.395654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.396101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.396864 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.397525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.505270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c88781b4-abe4-4b67-9ec3-862d710808f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28658 microversion: 2.1 time: 0.121179 Jan 28 01:29:49.505920 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 345/672] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:49 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28658 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:49.625572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:49.633862 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-afc54009-7946-456c-a56d-57b6a327898b tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1318 microversion: 2.1 time: 0.263020 Jan 28 01:29:49.634444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 328/673] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:49 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:29:49.790443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-1bd357f4-0652-44fb-aadf-804bdc80faa7 req-041afd4c-352e-4984-b66e-66ad4dff12fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "308490ce-028d-4c8d-a29d-12f024801270", "tag": "3707d82a-95ad-46f6-bce7-9e4732de5bcc"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:49.792500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:29:49.792500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:29:49.801337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-1bd357f4-0652-44fb-aadf-804bdc80faa7 req-041afd4c-352e-4984-b66e-66ad4dff12fd service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.801780 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-1bd357f4-0652-44fb-aadf-804bdc80faa7 req-041afd4c-352e-4984-b66e-66ad4dff12fd service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.814274 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-1bd357f4-0652-44fb-aadf-804bdc80faa7 req-041afd4c-352e-4984-b66e-66ad4dff12fd service nova] Creating event network-changed:3707d82a-95ad-46f6-bce7-9e4732de5bcc for instance 308490ce-028d-4c8d-a29d-12f024801270 on hv-cinder-82662 Jan 28 01:29:49.819244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-1bd357f4-0652-44fb-aadf-804bdc80faa7 req-041afd4c-352e-4984-b66e-66ad4dff12fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032873 Jan 28 01:29:49.819688 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 346/674] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:29:49.880897 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:49.881901 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:49.889111 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.889707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.890552 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.890985 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:49.923767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-30714837-7098-447d-b70b-25a790d176e7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047228 Jan 28 01:29:49.924530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 329/675] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jan 28 01:29:49 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:49.989828 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:49.990850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:49.999346 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:49.999889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.000872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.001362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.030714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:29:50.117437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-50971b47-f752-4f38-bb09-ccbfb14d7dac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 204 len: 0 microversion: 2.20 time: 0.132956 Jan 28 01:29:50.121274 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 347/676] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jan 28 01:29:49 2022] DELETE /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:29:50.129636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:50.130336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:50.138341 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.138697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.139488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.139937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.350254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:50.359590 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:50.361070 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:50.362565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-607d6a81-67c0-46e6-94de-f57d84f23ada tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.239070 Jan 28 01:29:50.363145 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 330/677] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:29:50 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:29:50.519505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:50.520658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:50.528740 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.529199 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.530033 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.530468 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.642811 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d863a2d9-9909-4ae3-81da-1db3aae153bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28658 microversion: 2.1 time: 0.127582 Jan 28 01:29:50.643648 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 348/678] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:50 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28658 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:50.654713 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:50.655822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:50.665020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.665499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.666306 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:50.666951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:50.898927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:50.906849 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-32d4c0c1-8e6e-410c-9cd4-0940e60d8d9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1318 microversion: 2.1 time: 0.258508 Jan 28 01:29:50.907340 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 331/679] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:50 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:51.381975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:51.382676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:51.389643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:51.390355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:51.391678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:51.391678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:51.544807 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:51.553640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:51.555152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:51.556327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e7721ed9-321f-49a4-a23d-038fe62bf105 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.178827 Jan 28 01:29:51.556958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 349/680] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:29:51 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:29:51.657427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:51.658460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:51.664935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:51.665408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:51.666201 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:51.666634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:51.762348 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-77366600-a8a4-4951-960b-0e97fa6dc6ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28658 microversion: 2.1 time: 0.108720 Jan 28 01:29:51.763007 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 332/681] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:51 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28658 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:51.934371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:51.934978 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:51.941858 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:51.942282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:51.943101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:51.943530 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:52.098815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:52.106901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cfd4d2f7-c1bb-4ffd-849b-2c38d5fc6fb7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1318 microversion: 2.1 time: 0.176194 Jan 28 01:29:52.107503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 350/682] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:51 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:52.575726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:52.576413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:52.585169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:52.585935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:52.587050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:52.587429 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:52.775934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:52.777030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:52.784519 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:52.785002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:52.785794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:52.786568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:52.864566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:52.876565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:52.878995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:52.880536 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5fec5781-790f-48c6-8d73-b472e28ddf48 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1720 microversion: 2.20 time: 0.308950 Jan 28 01:29:52.881133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 333/683] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:29:52 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1720 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:29:52.899208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-208e1e9b-523c-46b3-a09d-7d47ceca9e96 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 28690 microversion: 2.1 time: 0.126542 Jan 28 01:29:52.900229 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 351/684] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:52 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 28690 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:29:53.124071 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:53.124778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:53.133834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.134574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.136152 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.136875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.372840 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:53.390719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-385f7f8d-d521-4d90-b0a3-065036b7afeb tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1318 microversion: 2.1 time: 0.270221 Jan 28 01:29:53.400779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 334/685] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:53 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:53.436719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-e1d479ee-3666-4575-bfba-b24a1b3f031a req-b20b5227-0323-43d6-b098-2cc6365caa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee84016d-9001-4252-b16e-a4c1a7999a5a", "name": "network-vif-deleted", "tag": "869f9f99-4ded-4e21-8cbf-a43098e91931"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:53.438256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:29:53.438256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:29:53.465020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e1d479ee-3666-4575-bfba-b24a1b3f031a req-b20b5227-0323-43d6-b098-2cc6365caa44 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.465498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e1d479ee-3666-4575-bfba-b24a1b3f031a req-b20b5227-0323-43d6-b098-2cc6365caa44 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.486545 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-e1d479ee-3666-4575-bfba-b24a1b3f031a req-b20b5227-0323-43d6-b098-2cc6365caa44 service nova] Creating event network-vif-deleted:869f9f99-4ded-4e21-8cbf-a43098e91931 for instance ee84016d-9001-4252-b16e-a4c1a7999a5a on hv-cinder-82662 Jan 28 01:29:53.491636 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-e1d479ee-3666-4575-bfba-b24a1b3f031a req-b20b5227-0323-43d6-b098-2cc6365caa44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058867 Jan 28 01:29:53.492240 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 352/686] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:29:53.902051 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:53.902683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:53.911632 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.912625 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.913827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.914144 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:53.914638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.915964 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:53.924251 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.924988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.926151 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.926738 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.974700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:53.975642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:53.976328 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lazy-loading 'fault' on Instance uuid ee84016d-9001-4252-b16e-a4c1a7999a5a {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:29:54.034067 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:54.050017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:54.051586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:54.052766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f33af54c-a63f-44db-aa83-0095f93a0823 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 200 len: 1370 microversion: 2.20 time: 0.156734 Jan 28 01:29:54.053362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 335/687] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:29:53 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:29:54.070910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0018fced-75f0-4977-8f2a-436ef03c9ed1 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 30279 microversion: 2.1 time: 0.162708 Jan 28 01:29:54.071775 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 353/688] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:53 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 30279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:54.407740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:54.408350 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:54.414865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:54.415288 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:54.416097 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:54.416523 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:54.567318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:54.575330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-12e5fd60-f188-47be-8ab4-59d64872868a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1318 microversion: 2.1 time: 0.171187 Jan 28 01:29:54.584704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 336/689] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:54 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:54.593315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-e03a4a7e-6b4c-48b4-b322-64d435c3ce5b req-4259f1e1-5a1b-4cca-81f9-3f2c61832d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308490ce-028d-4c8d-a29d-12f024801270", "name": "network-vif-plugged", "status": "completed", "tag": "3707d82a-95ad-46f6-bce7-9e4732de5bcc"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:54.595449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:29:54.595449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:29:54.604717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e03a4a7e-6b4c-48b4-b322-64d435c3ce5b req-4259f1e1-5a1b-4cca-81f9-3f2c61832d96 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:54.605304 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e03a4a7e-6b4c-48b4-b322-64d435c3ce5b req-4259f1e1-5a1b-4cca-81f9-3f2c61832d96 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:54.624907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-e03a4a7e-6b4c-48b4-b322-64d435c3ce5b req-4259f1e1-5a1b-4cca-81f9-3f2c61832d96 service nova] Creating event network-vif-plugged:3707d82a-95ad-46f6-bce7-9e4732de5bcc for instance 308490ce-028d-4c8d-a29d-12f024801270 on hv-cinder-82662 Jan 28 01:29:54.631265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-e03a4a7e-6b4c-48b4-b322-64d435c3ce5b req-4259f1e1-5a1b-4cca-81f9-3f2c61832d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042602 Jan 28 01:29:54.632489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 354/690] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:29:55.073647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:55.074238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:55.081572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:55.082022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:55.082818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:55.083251 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:55.087091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:55.088329 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:55.094600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:55.095048 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:55.096083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:55.096522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:55.099324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] HTTP exception thrown: Instance ee84016d-9001-4252-b16e-a4c1a7999a5a could not be found. Jan 28 01:29:55.099935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Returning 404 to user: Instance ee84016d-9001-4252-b16e-a4c1a7999a5a could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:29:55.100808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-314af60a-07f8-457c-a904-a25452635550 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 404 len: 111 microversion: 2.20 time: 0.031238 Jan 28 01:29:55.101635 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 337/691] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:29:55 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:29:55.111460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3979e656-42b7-4080-80de-26663a2b1c9f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '.version_select at 0x7f7e76f325e0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:55.132196 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3979e656-42b7-4080-80de-26663a2b1c9f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-890896405" status: 204 len: 0 microversion: 2.20 time: 0.025885 Jan 28 01:29:55.132800 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 338/692] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Jan 28 01:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-890896405 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:29:55.370478 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e98923ac-8d00-4b4e-9203-9e62a3eacfb5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 32094 microversion: 2.1 time: 0.288894 Jan 28 01:29:55.371239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 355/693] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:55 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 32094 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:55.595861 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:55.596837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:55.605545 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:55.607207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:55.607207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:55.607745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:55.841424 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:55.853047 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-98689043-d879-4f1a-9ec7-93e21ca362ba tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1318 microversion: 2.1 time: 0.263418 Jan 28 01:29:55.854264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 339/694] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:55 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:55.987595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d7084c52-ca63-4d5e-9dff-f844221ded8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'create', calling method: .version_select at 0x7f7e76ddd310>, body: {"keypair": {"name": "tempest-keypair-511037946"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:56.004964 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d7084c52-ca63-4d5e-9dff-f844221ded8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:56.009630 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d7084c52-ca63-4d5e-9dff-f844221ded8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for user 3cd1ffeab8d74519a9b0d2d202e1cf6e and project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:56.365255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d7084c52-ca63-4d5e-9dff-f844221ded8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:56.372723 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d7084c52-ca63-4d5e-9dff-f844221ded8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for user 3cd1ffeab8d74519a9b0d2d202e1cf6e and project 33608c07529f42299cd9ae077624ebdc. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:56.387938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:56.389557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:56.392791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d7084c52-ca63-4d5e-9dff-f844221ded8d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.409297 Jan 28 01:29:56.393774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 356/695] 10.222.0.16 () {62 vars in 1198 bytes} [Fri Jan 28 01:29:55 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 412 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jan 28 01:29:56.399895 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:56.400696 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:56.402051 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:56.402655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:56.518141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-48f16f02-e75e-4bae-8c94-abea360968e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 33168 microversion: 2.1 time: 0.135927 Jan 28 01:29:56.519540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 340/696] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:56 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 33168 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:56.874869 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:56.875678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:56.882639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:56.883178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:56.884122 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:56.884888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:57.339962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:57.348077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-70ee99c6-86f2-401a-928d-7d5660ef7a0a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1507 microversion: 2.1 time: 0.477052 Jan 28 01:29:57.348666 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 357/697] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:29:56 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1507 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:29:57.532003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:57.533073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:57.540319 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:57.540740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:57.541802 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:57.542423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:57.665016 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-37141967-9165-4d9d-9996-0b5365b431af tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 33825 microversion: 2.1 time: 0.136616 Jan 28 01:29:57.666258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 341/698] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:57 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 33825 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:29:58.185141 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1971021007", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3332b276-5138-457d-8c65-3cdaf545d049"}], "security_groups": [{"name": "tempest-securitygroup--471568146"}], "key_name": "tempest-keypair-511037946", "user_data": "}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:58.290588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] validate_networks() for [('3332b276-5138-457d-8c65-3cdaf545d049', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:29:58.683158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:58.684166 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:58.692009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:58.692442 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:58.693224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:58.693698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:58.761819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:29:58.762312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:29:58.763072 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:29:58.765134 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:29:58.765615 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:29:58.779886 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:58.780449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:58.781563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:58.782142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:58.812776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for project 33608c07529f42299cd9ae077624ebdc. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:29:58.819146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Getting quotas for user 3cd1ffeab8d74519a9b0d2d202e1cf6e and project 33608c07529f42299cd9ae077624ebdc. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:29:58.835944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:29:58.836922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c85cfe17-4025-41c0-a88a-809014fa7006 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 34669 microversion: 2.1 time: 0.159933 Jan 28 01:29:58.837637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 342/699] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:58 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 34669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:29:58.842230 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:29:58.894739 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-29cad977-2e8d-4a97-9078-0a884e18074b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.713590 Jan 28 01:29:58.895497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 358/700] 10.222.0.16 () {62 vars in 1187 bytes} [Fri Jan 28 01:29:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 28 01:29:58.908767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-411707fb-ce72-416e-b672-674f8f8b22f8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:29:58.909601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-411707fb-ce72-416e-b672-674f8f8b22f8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:58.977298 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-411707fb-ce72-416e-b672-674f8f8b22f8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:58.984845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-411707fb-ce72-416e-b672-674f8f8b22f8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:58.986582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-411707fb-ce72-416e-b672-674f8f8b22f8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:29:58.987783 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-411707fb-ce72-416e-b672-674f8f8b22f8 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1281 microversion: 2.20 time: 0.083151 Jan 28 01:29:58.988386 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 343/701] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:29:58 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1281 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:29:59.850913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:29:59.851848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:29:59.859750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:59.860408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:59.861343 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:29:59.861872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:29:59.973931 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-dadbe845-4d34-4c24-bfe1-2b18cfaf0f6d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 35252 microversion: 2.1 time: 0.127212 Jan 28 01:29:59.974589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 359/702] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:29:59 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 35252 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:00.006208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:00.007264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:00.014444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:00.014916 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:00.015853 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:00.016272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:00.274457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:00.284585 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:00.286475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:00.287788 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d349b72c-065e-43e2-80e8-205f662f6b1a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1333 microversion: 2.20 time: 0.285589 Jan 28 01:30:00.288457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 344/703] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:00 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1333 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:30:00.991226 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:00.994010 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:01.006223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:01.007086 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:01.008197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:01.008902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:01.162373 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bcb35b92-c7d4-427c-b556-11b6190052ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 36065 microversion: 2.1 time: 0.178149 Jan 28 01:30:01.165380 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 360/704] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:00 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 36065 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:01.310457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:01.311153 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:01.320183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:01.320842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:01.321822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:01.322502 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:01.573744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:01.583381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:01.584982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:01.586131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ee13e346-7ddf-46fd-af22-043b0ff34cbe tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.282559 Jan 28 01:30:01.587006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 345/705] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:01 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:01.973572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-8d2d6e8b-3e88-4137-875d-b2640ca3a5b4 req-c83e1e95-f388-49e0-982b-e3725292ee5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:01.978647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:30:01.978647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:30:02.006529 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-8d2d6e8b-3e88-4137-875d-b2640ca3a5b4 req-c83e1e95-f388-49e0-982b-e3725292ee5f service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:02.008591 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-8d2d6e8b-3e88-4137-875d-b2640ca3a5b4 req-c83e1e95-f388-49e0-982b-e3725292ee5f service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:02.060277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-8d2d6e8b-3e88-4137-875d-b2640ca3a5b4 req-c83e1e95-f388-49e0-982b-e3725292ee5f service nova] Creating event network-changed:df468b4e-46d6-4769-9495-a4ac5d9a0e37 for instance 0c460d75-9b3c-4039-94e9-86867faebbbe on hv-cinder-82662 Jan 28 01:30:02.069032 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-8d2d6e8b-3e88-4137-875d-b2640ca3a5b4 req-c83e1e95-f388-49e0-982b-e3725292ee5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114881 Jan 28 01:30:02.071094 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 361/706] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:30:02.176917 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:02.178782 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:02.187384 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:02.188182 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:02.189628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:02.190182 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:02.307392 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-09302e1d-88a3-457b-9117-0fb2872465e2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 36997 microversion: 2.1 time: 0.134592 Jan 28 01:30:02.308589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 346/707] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:02 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 36997 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:02.615231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:02.616761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:02.632098 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:02.632768 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:02.634453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:02.634640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:03.002441 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:03.015850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:03.021163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:03.021163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-14dcf78e-a01e-44a6-8376-8c4a56dc88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.415385 Jan 28 01:30:03.021688 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 362/708] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:02 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:03.320420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:03.321521 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:03.340050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:03.340728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:03.341772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:03.342388 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:03.462233 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-793571e0-338f-42eb-920d-c8707580a2e8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 37898 microversion: 2.1 time: 0.145652 Jan 28 01:30:03.463220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 347/709] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:03 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 37898 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:04.039465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:04.040074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:04.046842 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:04.047289 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:04.048064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:04.048492 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:04.189862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:04.198262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:04.199856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:04.200972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bd84fb53-0ac5-426c-85d4-13e4b75c8f27 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.165374 Jan 28 01:30:04.201735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 363/710] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:04 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:04.476072 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:04.477076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:04.484481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:04.484927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:04.485750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:04.486174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:04.584340 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-532b0076-e8dd-467f-a882-4dbf872f891d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 38191 microversion: 2.1 time: 0.112470 Jan 28 01:30:04.585122 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 348/711] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:04 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 38191 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:05.222163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:05.223138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:05.234466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:05.235088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:05.236070 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:05.236492 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:05.391163 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:05.399520 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:05.401027 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:05.402344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-eed5861f-2df7-401e-ae78-92aa743eae17 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.186681 Jan 28 01:30:05.402890 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 364/712] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:05 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:05.596845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:05.597792 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:05.605014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:05.605515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:05.606448 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:05.606882 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:05.712215 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4b411ab7-8049-4877-b1a9-4694103376a0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 38191 microversion: 2.1 time: 0.119328 Jan 28 01:30:05.712868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 349/713] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:05 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 38191 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:06.494906 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:06.495450 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:06.511930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:06.512684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:06.514518 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:06.515637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:06.677925 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:06.686241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:06.687733 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:06.688849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6805a56f-f409-4158-aed6-3631d76373b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.271670 Jan 28 01:30:06.689642 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 365/714] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:06 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:06.726941 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:06.727952 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:06.739021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:06.739565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:06.740461 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:06.741083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:06.842831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a6e0dcc0-de4d-40b0-a60e-6296fd81cd61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 200 len: 38322 microversion: 2.1 time: 0.119842 Jan 28 01:30:06.843593 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 350/715] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:06 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 38322 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:06.854029 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:06.854716 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:06.861276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:06.861798 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:06.862664 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:06.863129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:06.899234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-80305c17-6f42-47db-b195-7126cb575497 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/ips" status: 200 len: 147 microversion: 2.1 time: 0.048650 Jan 28 01:30:06.900035 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 366/716] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jan 28 01:30:06 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:30:07.712962 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:07.713700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:07.720960 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:07.721449 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:07.722244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:07.722673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:07.872025 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:07.880695 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:07.882297 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:07.883434 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-13d62bac-af14-4212-a382-b7e8f40c55c0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.174881 Jan 28 01:30:07.883986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 351/717] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:07 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:08.490888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-ca2c6495-9624-49b9-8b34-6e4b4d61a676 req-28b7dd72-9cba-45a7-91c8-a4989209f35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "name": "network-vif-plugged", "status": "completed", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:08.490888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:30:08.490888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:30:08.498002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ca2c6495-9624-49b9-8b34-6e4b4d61a676 req-28b7dd72-9cba-45a7-91c8-a4989209f35f service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:08.498439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ca2c6495-9624-49b9-8b34-6e4b4d61a676 req-28b7dd72-9cba-45a7-91c8-a4989209f35f service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:08.511975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-ca2c6495-9624-49b9-8b34-6e4b4d61a676 req-28b7dd72-9cba-45a7-91c8-a4989209f35f service nova] Creating event network-vif-plugged:df468b4e-46d6-4769-9495-a4ac5d9a0e37 for instance 0c460d75-9b3c-4039-94e9-86867faebbbe on hv-cinder-82662 Jan 28 01:30:08.521282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-ca2c6495-9624-49b9-8b34-6e4b4d61a676 req-28b7dd72-9cba-45a7-91c8-a4989209f35f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035702 Jan 28 01:30:08.522913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 367/718] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:30:08.904713 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:08.905846 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:08.915756 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:08.916200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:08.916999 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:08.917465 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:09.067237 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:09.078214 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:09.080237 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:09.081437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-184fde5f-4116-4c62-9b48-821076317dad tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.182525 Jan 28 01:30:09.082006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 352/719] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:08 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:09.560541 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1bbac77-6f22-4fb8-95e4-6fb0ebfe22de"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:09.562085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:09.569505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:09.569834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:09.570627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:09.571067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:09.915088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f15e17ac-fcec-4533-b826-8b6a282df8d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363770 Jan 28 01:30:09.915735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 368/720] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:30:09 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:30:10.112956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:10.113928 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:10.124673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:10.125428 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:10.126720 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:10.127439 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:10.309377 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:10.320844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:10.322502 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:10.324045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cfdff860-01d7-4c73-b640-c21dec89b79b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1406 microversion: 2.20 time: 0.217301 Jan 28 01:30:10.337266 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 353/721] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:10 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:30:11.350189 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:11.350891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:11.358311 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:11.358756 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:11.359553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:11.359977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:11.506215 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:11.519269 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:11.520797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:11.522106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-aba96203-60a1-4345-8b6e-030807fd75a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1598 microversion: 2.20 time: 0.176074 Jan 28 01:30:11.522675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 369/722] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:30:11 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1598 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:30:11.550560 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:11.551459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:11.558609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:11.559061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:11.559861 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:11.560296 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:11.672658 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-faf7bf1d-ae25-4292-b56a-4f1c7833ff32 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.126313 Jan 28 01:30:11.673767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 354/723] 10.222.0.16 () {60 vars in 1315 bytes} [Fri Jan 28 01:30:11 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:30:12.719158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:12.724111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:12.725755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-56824222-fb5d-4147-ba5f-f30d7cd4d570 req-5964ce67-ed67-48a9-a454-14e5cf10b21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:12.728173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:30:12.728173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:30:12.737334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-56824222-fb5d-4147-ba5f-f30d7cd4d570 req-5964ce67-ed67-48a9-a454-14e5cf10b21b service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:12.738151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-56824222-fb5d-4147-ba5f-f30d7cd4d570 req-5964ce67-ed67-48a9-a454-14e5cf10b21b service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:12.746262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:12.747063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:12.748875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:12.749710 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:12.752194 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-56824222-fb5d-4147-ba5f-f30d7cd4d570 req-5964ce67-ed67-48a9-a454-14e5cf10b21b service nova] Creating event network-changed:df468b4e-46d6-4769-9495-a4ac5d9a0e37 for instance 0c460d75-9b3c-4039-94e9-86867faebbbe on hv-cinder-82662 Jan 28 01:30:12.759797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-56824222-fb5d-4147-ba5f-f30d7cd4d570 req-5964ce67-ed67-48a9-a454-14e5cf10b21b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037723 Jan 28 01:30:12.768040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 355/724] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:30:12.892464 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-616f109d-d263-43fc-a4f3-5fba6e932501 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.179636 Jan 28 01:30:12.893382 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 370/725] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:12 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:13.907962 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:13.909677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:13.918574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:13.919440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:13.920620 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:13.921897 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:14.033528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-26478330-0560-4f2f-8e9c-24281d5ca325 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.132492 Jan 28 01:30:14.034216 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 356/726] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:13 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:15.045614 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:15.046613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:15.054061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:15.054505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:15.055286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:15.055716 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:15.161669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31743fa4-161e-41f0-adc5-3e179aab495c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.119884 Jan 28 01:30:15.162442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 371/727] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:15 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:15.955799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d423d5e-36b2-48da-b276-e25678ca39b0", "device": "/dev/sdb"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:15.957461 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:15.964648 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:15.965084 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:15.965892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:15.966316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:16.173473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:16.174502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:16.181464 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:16.181636 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:16.182388 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:16.182831 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:16.233147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5ccf1166-653c-4a00-9698-c0794fa0c82a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "POST /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281836 Jan 28 01:30:16.234406 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 357/728] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:30:15 2022] POST /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:30:16.282280 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b0cdbd30-0d36-42b7-b364-74f6d505597d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.113082 Jan 28 01:30:16.283045 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 372/729] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:16 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:17.298220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:17.299259 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:17.306209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:17.306661 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:17.307462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:17.307889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:17.450669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-75ab34cc-d1ce-408a-9a59-566e6186c7ce tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.159488 Jan 28 01:30:17.451874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 358/730] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:17 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:17.544424 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5dce31cd-26d0-4399-84a7-962d607c4e28 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:17.551614 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5dce31cd-26d0-4399-84a7-962d607c4e28 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:17.552052 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5dce31cd-26d0-4399-84a7-962d607c4e28 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:17.614884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5dce31cd-26d0-4399-84a7-962d607c4e28 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Going to try to stop instance {{(pid=116162) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 01:30:17.663361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5dce31cd-26d0-4399-84a7-962d607c4e28 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 202 len: 0 microversion: 2.1 time: 0.123151 Jan 28 01:30:17.664369 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 373/731] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:17 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:30:17.673141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:17.673877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:17.681135 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:17.682062 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:17.682664 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:17.683113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:17.846090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:17.854902 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2c803d2a-dee4-4825-ab60-845943b8c123 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.185724 Jan 28 01:30:17.855493 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 359/732] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:17 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:18.465045 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:18.466371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:18.473738 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:18.474191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:18.475113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:18.475548 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:18.576787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e6581a20-741b-4c4a-bf4a-e62f1d92b3e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.115808 Jan 28 01:30:18.577482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 374/733] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:18 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:18.873894 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:18.874815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:18.881125 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:18.881568 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:18.882361 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:18.882799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:19.045107 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:19.057024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7910b5b6-28d4-47d8-ad05-d701f45c64a4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.186493 Jan 28 01:30:19.058168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 360/734] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:18 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:19.590699 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:19.591735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:19.600341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:19.601090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:19.602128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:19.602662 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:19.712421 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6bc4c62a-f06e-42b3-9847-b6173b79a062 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.125134 Jan 28 01:30:19.716550 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 375/735] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:19 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:20.075770 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:20.076342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:20.084875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:20.085515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:20.086685 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:20.087249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:20.242261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:20.251197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-49f04f8d-b7df-4da7-9414-a14e8768e821 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.179245 Jan 28 01:30:20.251771 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 361/736] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:20 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:20.725868 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:20.726888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:20.734358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:20.734812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:20.735602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:20.736041 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:20.831620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1c22e9d9-9039-4e72-8f7a-9dd900fc71f4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.110241 Jan 28 01:30:20.832181 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 376/737] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:20 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:21.268993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:21.269943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:21.276183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:21.276671 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:21.277582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:21.278159 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:21.433905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:21.443999 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b5c1f549-df05-492f-9707-7b09a6ddcbf3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.178553 Jan 28 01:30:21.444748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 362/738] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:21 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:21.844640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:21.845613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:21.855193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:21.855838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:21.856844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:21.857637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:21.961394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-161bbdd8-18d3-4de4-b33b-ff01a1b833b0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.120948 Jan 28 01:30:21.962296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 377/739] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:21 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:22.462879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:22.463550 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:22.470534 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:22.470992 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:22.471797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:22.472231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:22.651082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:22.664607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c8902f16-f974-4d37-8ee4-8b00dd852c65 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.205120 Jan 28 01:30:22.665644 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 363/740] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:22 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:22.973138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:22.974228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:22.981555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:22.982016 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:22.982902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:22.983377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:23.114439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cac58705-a86f-409b-b62e-ad27ace00e49 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.145413 Jan 28 01:30:23.115106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 378/741] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:22 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:23.690236 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:23.691146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:23.698736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:23.699254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:23.700097 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:23.700603 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:23.888103 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:23.898342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cca76117-6c20-4f81-b05b-27c69c905746 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.212476 Jan 28 01:30:23.899311 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 364/742] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:23 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:24.126185 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:24.127233 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:24.134951 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:24.135544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:24.136546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:24.137077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:24.274074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d7ee0db2-2ff5-432e-bcbc-5bb2a9bfe210 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 14 microversion: 2.20 time: 0.151575 Jan 28 01:30:24.274728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 379/743] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:24 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:24.924305 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:24.924922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:24.931953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:24.932387 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:24.933312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:24.933740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:25.117006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:25.125698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2ef2ead6-6996-4527-8bf7-2487edce5711 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.204916 Jan 28 01:30:25.126687 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 365/744] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:24 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:25.286911 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:25.288051 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:25.295395 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:25.295850 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:25.296632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:25.297066 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:25.397554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7cab77d3-c177-48ac-ab08-edc742ede9e9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 376 microversion: 2.20 time: 0.115176 Jan 28 01:30:25.398209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 380/745] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:25 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 376 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:30:26.143748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:26.144405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:26.151036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:26.151482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:26.152293 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:26.152719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:26.292815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:26.301847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9f89ba1b-1702-4aab-9b3c-45d44c153f6a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.161613 Jan 28 01:30:26.303214 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 366/746] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:26 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:26.409258 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:26.410452 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:26.417843 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:26.418295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:26.419087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:26.419521 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:27.319945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:27.320589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:27.327202 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:27.327652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:27.328988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:27.329452 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:27.480053 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:27.489012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ce80c3ef-c56b-4ee1-b49a-5912d4a3136b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.172762 Jan 28 01:30:27.489676 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 367/747] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:27 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:28.117447 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9806c3eb-6a30-4b36-80e8-7b29877309d5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 18356 microversion: 2.20 time: 1.712042 Jan 28 01:30:28.118729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 381/748] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:26 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 18356 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:28.506244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:28.507042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:28.515628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:28.516395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:28.517187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:28.517643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:28.655922 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:28.665342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2328dd6d-fc43-44c2-959e-561a273688d3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.162887 Jan 28 01:30:28.665910 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 368/749] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:28 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:29.133435 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:29.135286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:29.144499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:29.144950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:29.145776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:29.146210 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:29.276012 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5ee19ed6-8a7b-47f2-895a-611b528a1a59 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 19342 microversion: 2.20 time: 0.148905 Jan 28 01:30:29.276681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 382/750] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:29 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 19342 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:29.683427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:29.684010 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:29.690729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:29.691173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:29.691966 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:29.692394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:29.835520 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:29.844770 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b4c8765d-e9db-4bb1-94b9-8c9a10e0c0fb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.165635 Jan 28 01:30:29.845503 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 369/751] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:29 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:30.288967 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:30.290228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:30.297672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:30.298156 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:30.298949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:30.299387 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:30.862482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:30.863183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:30.870504 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:30.870951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:30.871965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:30.871965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:31.048423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:31.060837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3d0aee7a-20bc-4812-8ce4-a69add731e7b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.201989 Jan 28 01:30:31.061473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 370/752] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:30 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:32.079256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:32.080348 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:32.086813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:32.087277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:32.088176 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:32.088631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:32.237739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:32.246596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c20cfe89-290f-4473-9fa1-38749baf62c4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.171408 Jan 28 01:30:32.247186 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 371/753] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:32 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:32.484448 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-40c392b7-84ad-43ca-a670-aa061dd37942 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 23804 microversion: 2.20 time: 2.199435 Jan 28 01:30:32.485321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 383/754] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:30 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 23804 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:33.263287 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:33.263915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:33.271285 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:33.271700 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:33.272647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:33.273009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:33.431011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:33.439671 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8246852c-ea8c-4498-bf69-86aca76f2b3c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.180027 Jan 28 01:30:33.440252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 372/755] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:33 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:33.498558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:33.499650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:33.510375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:33.510832 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:33.511701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:33.512147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:33.625506 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-dfdbaf96-14d3-4d85-af74-d4e869e4966f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 24654 microversion: 2.20 time: 0.131796 Jan 28 01:30:33.626301 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 384/756] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:33 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 24654 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:34.460752 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:34.462024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:34.474580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:34.475412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:34.476871 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:34.477459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:34.645168 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:34.647510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:34.662633 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:34.662633 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:34.664123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:34.665257 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:34.673541 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:34.687834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-87a72c3f-8260-455e-b25e-73a8926b7090 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.233578 Jan 28 01:30:34.689146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 373/757] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:34 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:35.706578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:35.707248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:35.714507 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:35.715048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:35.715930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:35.716394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:35.872237 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:35.882396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6c371d34-7eb5-489c-b2ea-d8958604bc4c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.179803 Jan 28 01:30:35.884499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 374/758] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:35 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:36.897973 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d8fbc20f-5674-44b5-ba9c-43880f7bfaed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 26844 microversion: 2.20 time: 2.260869 Jan 28 01:30:36.898750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 385/759] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:34 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 26844 bytes in 2263 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:36.903011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:36.903645 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:36.910469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:36.912096 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:36.912362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:36.912806 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:37.078776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:37.091963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d0e546c2-4b7f-4f1d-9281-2e51fd982cbb tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.194771 Jan 28 01:30:37.092917 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 375/760] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:36 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:30:37.913360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:37.914907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:37.927744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:37.928439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:37.929912 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:37.930694 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:38.050385 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c79884c8-77fc-45ed-adaa-f5b7252eb33f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 27397 microversion: 2.20 time: 0.142733 Jan 28 01:30:38.051052 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 386/761] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:37 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 27397 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:38.118168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:38.118783 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:38.126892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:38.127644 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:38.128961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:38.129556 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:38.307983 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:38.321459 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1e0b4dca-c465-4f9a-934f-72fde5295dd2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1725 microversion: 2.1 time: 0.207148 Jan 28 01:30:38.325295 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 376/762] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:38 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:39.064011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:39.065097 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:39.073331 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.073873 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.074827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.075312 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.186872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-40774a00-449f-4961-93d8-b3cc30054cf9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 27830 microversion: 2.20 time: 0.126553 Jan 28 01:30:39.188007 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 387/763] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:39 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 27830 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:39.349965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:39.350998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:39.362483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.363238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.368799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.369772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.527004 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:39.541759 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1897436f-96d5-46a4-9318-7279faee1327 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1702 microversion: 2.1 time: 0.198817 Jan 28 01:30:39.542246 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 377/764] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:39 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1702 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:39.559201 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b120800c-50b3-432b-b3af-9c221d46eb7c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:39.567938 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b120800c-50b3-432b-b3af-9c221d46eb7c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.568740 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b120800c-50b3-432b-b3af-9c221d46eb7c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.596191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b120800c-50b3-432b-b3af-9c221d46eb7c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Going to try to start instance {{(pid=116162) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 01:30:39.654892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b120800c-50b3-432b-b3af-9c221d46eb7c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 202 len: 0 microversion: 2.1 time: 0.099954 Jan 28 01:30:39.655782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 388/765] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:30:39 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:30:39.666250 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:39.666987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:39.677720 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.678444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.679631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:39.680267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:39.858830 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:39.869856 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f8d72d91-dc1e-4ed9-a718-870ad61c1ec7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1711 microversion: 2.1 time: 0.207733 Jan 28 01:30:39.870537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 378/766] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:39 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1711 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:40.201428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:40.202446 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:40.215160 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:40.215617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:40.216434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:40.216867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:40.354092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2ab8c871-799a-4826-bc67-904ede45ec98 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28055 microversion: 2.20 time: 0.157876 Jan 28 01:30:40.358727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 389/767] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:40 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28055 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:40.888502 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:40.889369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:40.896803 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:40.897345 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:40.898270 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:40.898730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:41.093353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:41.104977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-741919e2-565c-4f6e-929d-a0c57c9a2daf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1711 microversion: 2.1 time: 0.220300 Jan 28 01:30:41.106023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 379/768] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:40 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1711 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:41.328690 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:41.329440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:41.337110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:41.337889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:41.338787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:41.339137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:41.366897 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:41.368354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:41.377956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:41.378757 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:41.379621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:41.380183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:41.465054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lazy-loading 'services' on Instance uuid 308490ce-028d-4c8d-a29d-12f024801270 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:30:41.586766 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2bd4172a-0b60-4c7c-a345-f048b6c6f598 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28198 microversion: 2.20 time: 0.223235 Jan 28 01:30:41.587827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 380/769] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:41 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28198 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:41.590315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a437ee30-9027-4a32-bbf0-a3b284ab2c1f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "DELETE /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270/os-volume_attachments/4d423d5e-36b2-48da-b276-e25678ca39b0" status: 202 len: 0 microversion: 2.1 time: 0.265447 Jan 28 01:30:41.591772 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 390/770] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:30:41 2022] DELETE /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270/os-volume_attachments/4d423d5e-36b2-48da-b276-e25678ca39b0 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:42.130814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:42.131799 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:42.142844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:42.143439 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:42.144610 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:42.145188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:42.346362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:42.361563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7075c110-29e7-4ce1-a261-a61db34b19aa tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1715 microversion: 2.1 time: 0.236600 Jan 28 01:30:42.362146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 381/771] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:42 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1715 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:42.610087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:42.611379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:42.620624 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:42.621136 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:42.623019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:42.624513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:42.763950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5f3f28f7-c067-47f0-8aa5-df35a129ca5f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28198 microversion: 2.20 time: 0.166077 Jan 28 01:30:42.764882 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 391/772] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:42 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28198 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:43.779390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:43.780348 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:43.787022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:43.787482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:43.788301 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:43.788877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:43.834975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:43.835750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:43.843298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:43.843766 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:43.844563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:43.845003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:43.873111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:30:43.936629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0e13bfa9-9833-4969-aeef-399dc9decf3d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28450 microversion: 2.20 time: 0.162348 Jan 28 01:30:43.938437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 382/773] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:43 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:43.970900 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5d9b963f-2dd5-4f78-a3d2-a43f102aa251 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "DELETE /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 204 len: 0 microversion: 2.1 time: 0.139492 Jan 28 01:30:43.971744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 392/774] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:30:43 2022] DELETE /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:30:43.983837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:43.984717 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:43.995848 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:43.996224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:43.997401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:43.998142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:44.162959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:44.177980 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1e737089-2feb-4646-b303-cbec0ed64227 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1513 microversion: 2.1 time: 0.199175 Jan 28 01:30:44.179020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 383/775] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:43 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:44.955262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:44.957307 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:44.966020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:44.966430 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:44.967231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:44.967668 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:45.119188 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-72f352f8-efe3-4fdc-8e82-c2c77a8f4b3f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28488 microversion: 2.20 time: 0.170393 Jan 28 01:30:45.120335 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 393/776] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:44 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28488 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:45.209022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:45.210073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:45.219639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:45.220073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:45.220870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:45.221324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:45.428275 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:45.437350 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-83f2dd5d-fea7-4cb7-a07c-8ca861650bd5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1513 microversion: 2.1 time: 0.235737 Jan 28 01:30:45.437998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 384/777] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:45 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:46.138579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:46.140362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:46.148084 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:46.148563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:46.149406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:46.149866 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:46.277917 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-41d7a2c9-0509-44fc-93e3-b67e3aec3278 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28653 microversion: 2.20 time: 0.148707 Jan 28 01:30:46.278581 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 394/778] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:46 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28653 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:46.456609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:46.458089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:46.464828 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:46.465304 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:46.466105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:46.466854 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:46.689133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:46.696931 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-519521b3-595b-4695-992a-ce4824199871 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 200 len: 1513 microversion: 2.1 time: 0.245458 Jan 28 01:30:46.697539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 385/779] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:46 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:47.068887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-4244ec9c-3263-4a0e-a798-c6e5b4839610 req-6590e0f5-2a5e-4a6f-a214-f37625f2e3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "308490ce-028d-4c8d-a29d-12f024801270", "name": "network-vif-deleted", "tag": "3707d82a-95ad-46f6-bce7-9e4732de5bcc"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:47.070490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:30:47.070490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:30:47.081293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-4244ec9c-3263-4a0e-a798-c6e5b4839610 req-6590e0f5-2a5e-4a6f-a214-f37625f2e3d4 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:47.081732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-4244ec9c-3263-4a0e-a798-c6e5b4839610 req-6590e0f5-2a5e-4a6f-a214-f37625f2e3d4 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:47.092349 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-4244ec9c-3263-4a0e-a798-c6e5b4839610 req-6590e0f5-2a5e-4a6f-a214-f37625f2e3d4 service nova] Creating event network-vif-deleted:3707d82a-95ad-46f6-bce7-9e4732de5bcc for instance 308490ce-028d-4c8d-a29d-12f024801270 on hv-cinder-82662 Jan 28 01:30:47.097658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-4244ec9c-3263-4a0e-a798-c6e5b4839610 req-6590e0f5-2a5e-4a6f-a214-f37625f2e3d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095938 Jan 28 01:30:47.098377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 395/780] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:30:47.290532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:47.291391 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:47.299464 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:47.299940 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:47.300885 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:47.301567 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:47.405855 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c1319808-67f0-4c72-941f-f992a2bd5e0f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28653 microversion: 2.20 time: 0.118791 Jan 28 01:30:47.406558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 386/781] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:47 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28653 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:47.715362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:47.716059 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 308490ce-028d-4c8d-a29d-12f024801270] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:47.722681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:47.723128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:47.723911 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:47.724375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:47.738101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] HTTP exception thrown: Instance 308490ce-028d-4c8d-a29d-12f024801270 could not be found. Jan 28 01:30:47.738701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Returning 404 to user: Instance 308490ce-028d-4c8d-a29d-12f024801270 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:30:47.739567 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d1c720bc-3543-4980-be6a-e9b8fa2237c1 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270" status: 404 len: 111 microversion: 2.1 time: 0.028832 Jan 28 01:30:47.740105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 396/782] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:47 2022] GET /compute/v2.1/servers/308490ce-028d-4c8d-a29d-12f024801270 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:30:48.419841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:48.420896 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:48.428211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:48.428654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:48.429486 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:48.429921 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:50.815218 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-beecb24c-b425-490b-9d2e-d6ae777d88ed tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28653 microversion: 2.20 time: 2.399240 Jan 28 01:30:50.815867 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 387/783] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:48 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28653 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:51.828198 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:51.829005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:51.835732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:51.836180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:51.836956 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:51.837429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:51.926226 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6105750f-a6c4-4942-86d6-92cab1d0b6d0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28653 microversion: 2.20 time: 0.102027 Jan 28 01:30:51.927177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 397/784] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:51 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28653 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:52.939279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:52.940271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:52.948337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:52.948779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:52.949594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:52.950022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:55.271584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-46f086c3-fbce-4092-b96c-77fca0a7cbb0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 28653 microversion: 2.20 time: 2.336042 Jan 28 01:30:55.272532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 388/785] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:52 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 28653 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:30:55.519815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1964848763", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "f38edd44-ee68-4f04-b487-0fc08b20b6d9"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:55.578797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] validate_networks() for [('f38edd44-ee68-4f04-b487-0fc08b20b6d9', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:30:55.994123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:30:55.994544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:30:55.995008 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:30:55.995419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:30:55.995823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:30:56.005064 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:56.005637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:56.006442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:56.006872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:56.023300 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Getting quotas for project a1700ad15ae3467494fdcc80ffd1a648. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:30:56.027374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Getting quotas for user 65a9be47ecd648508ef952ebb42a300a and project a1700ad15ae3467494fdcc80ffd1a648. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:30:56.038171 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:30:56.040583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:30:56.086027 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a919f444-df99-45d4-a222-f3abfcf0e1ce tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570172 Jan 28 01:30:56.086676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 398/786] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:30:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:30:56.103500 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6f60ca19-7bbd-4fdb-8f56-6ddb5115a15a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:56.104615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6f60ca19-7bbd-4fdb-8f56-6ddb5115a15a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:56.173058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6f60ca19-7bbd-4fdb-8f56-6ddb5115a15a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:56.180589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6f60ca19-7bbd-4fdb-8f56-6ddb5115a15a tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1219 microversion: 2.1 time: 0.084340 Jan 28 01:30:56.181173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 389/787] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:56 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:56.284961 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:56.286479 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:56.294011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:56.294593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:56.295379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:56.295848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:56.401616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c5649121-abf1-4025-a00d-21e353d3d203 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 29885 microversion: 2.20 time: 0.121455 Jan 28 01:30:56.406352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 399/788] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:56 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 29885 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:57.198209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:57.198934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:57.206092 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:57.207364 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:57.208042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:57.208709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:57.280462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:57.289391 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5e4667b2-1a76-4b04-b52c-e25846821d7f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1271 microversion: 2.1 time: 0.094898 Jan 28 01:30:57.289997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 390/789] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:57 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:57.414820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:57.416128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:57.426880 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:57.428032 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:57.429039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:57.429676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:57.571906 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ba077ba2-e903-4b23-a775-0b4f07fea361 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 31482 microversion: 2.20 time: 0.160693 Jan 28 01:30:57.572925 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 400/790] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:57 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 31482 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:58.310139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:58.310679 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:58.317125 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:58.317615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:58.318550 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:58.318988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:58.544779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:58.552429 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c4bb03c4-39a1-45af-9586-2d7a9a03ef41 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.246209 Jan 28 01:30:58.553269 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 391/791] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:58 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:30:58.585178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:58.586159 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:58.593386 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:58.593974 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:58.594841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:58.595347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:58.704030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-166ae30a-609e-4d64-bcba-66031f18218d tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 32886 microversion: 2.20 time: 0.123008 Jan 28 01:30:58.704810 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 401/792] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:58 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 32886 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:58.769987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-c288cf7b-4b48-4c6e-8ee5-01b9812cd37d req-3a7032f2-f3c7-4625-84a9-ec0675d10cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302ed740-59cc-4ccb-91cb-afc413f1e537", "tag": "61e0d2b9-4634-4891-a557-49e0463271e2"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:58.772565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:30:58.772565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:30:58.783095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-c288cf7b-4b48-4c6e-8ee5-01b9812cd37d req-3a7032f2-f3c7-4625-84a9-ec0675d10cda service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:58.783660 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-c288cf7b-4b48-4c6e-8ee5-01b9812cd37d req-3a7032f2-f3c7-4625-84a9-ec0675d10cda service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:58.799711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-c288cf7b-4b48-4c6e-8ee5-01b9812cd37d req-3a7032f2-f3c7-4625-84a9-ec0675d10cda service nova] Creating event network-changed:61e0d2b9-4634-4891-a557-49e0463271e2 for instance 302ed740-59cc-4ccb-91cb-afc413f1e537 on hv-cinder-82662 Jan 28 01:30:58.806249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-c288cf7b-4b48-4c6e-8ee5-01b9812cd37d req-3a7032f2-f3c7-4625-84a9-ec0675d10cda service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042795 Jan 28 01:30:58.807245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 392/793] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:30:59.571339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:30:59.572576 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:59.584833 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:59.585673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:59.587014 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:59.587772 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:59.722682 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:30:59.724396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:30:59.735211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:59.736024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:59.737452 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:30:59.738238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:30:59.861639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2c7a209f-563e-4565-b88d-240db738276c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 33583 microversion: 2.20 time: 0.147360 Jan 28 01:30:59.862302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 393/794] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:30:59 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 33583 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:30:59.889087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:30:59.900268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-58e5c791-dc9a-48e4-9360-9636cf6dff59 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.333869 Jan 28 01:30:59.900878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 402/795] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:30:59 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:00.326968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:00.327538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:00.335458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.335909 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.336702 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.337137 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.363710 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:31:00.455713 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b6232fe8-adf4-4816-a16d-211a4327d4fb tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "DELETE /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 204 len: 0 microversion: 2.1 time: 0.132470 Jan 28 01:31:00.456394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 394/796] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:31:00 2022] DELETE /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:31:00.467892 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:00.468957 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:00.477216 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.477830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.478779 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.479319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.634294 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:00.643991 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a4ebc231-75e2-4476-ac09-aa0c11548ce5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1575 microversion: 2.1 time: 0.181591 Jan 28 01:31:00.644763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 403/797] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:00 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:00.876036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:00.876960 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:00.884567 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.885042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.885879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.886314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.919565 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:00.920183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:00.926631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.927108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.927933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:00.928453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:00.998602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ccabd2d5-2445-4009-8bac-639746afaa3a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 34204 microversion: 2.20 time: 0.126584 Jan 28 01:31:01.003529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 395/798] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:00 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 34204 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:01.082253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:01.089805 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fc8415d7-6670-40ba-a2ee-94ff61e20ae4 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.175562 Jan 28 01:31:01.090391 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 404/799] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:00 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:01.666455 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:01.667220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:01.674542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:01.674981 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:01.675770 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:01.676201 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:01.836557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:01.844761 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-076a35e2-268c-4dee-807a-72607b5f37bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1575 microversion: 2.1 time: 0.184028 Jan 28 01:31:01.845594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 396/800] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:01 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:02.011627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:02.012836 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:02.020184 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:02.020711 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:02.021672 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:02.022165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:02.106877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:02.107626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:02.114750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:02.115202 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:02.116008 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:02.116438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:02.134736 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a207fba8-b89e-42af-bd31-0ef8f3b6cacb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 34969 microversion: 2.20 time: 0.126269 Jan 28 01:31:02.136034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 405/801] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:02 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 34969 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:31:02.266997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:02.281011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5ba8fca8-7b20-47ec-9340-f6b0260860d5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.178136 Jan 28 01:31:02.282027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 397/802] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:02 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:02.863773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:02.864479 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:02.872094 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:02.873208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:02.873525 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:02.873816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:03.114944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:03.123043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-aa4eb649-e6b0-412a-8dff-46e7bc1866aa tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1575 microversion: 2.1 time: 0.264147 Jan 28 01:31:03.123610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 406/803] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:02 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1575 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:03.150316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:03.151473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:03.159498 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:03.160011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:03.160915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:03.161537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:03.279918 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cb6d9c2f-5a85-440e-89c9-6ba0e70e5710 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 35837 microversion: 2.20 time: 0.135610 Jan 28 01:31:03.280891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 398/804] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:03 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 35837 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:03.303741 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:03.304447 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:03.312985 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:03.313539 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:03.314406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:03.314843 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:03.580344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:03.588486 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a019f5f6-c7d0-45b5-97c8-d2a3e3b79516 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.288422 Jan 28 01:31:03.589078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 407/805] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:03 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:04.116920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-c7258980-b964-4c76-a16d-3dc8c725f83b req-0221075c-ef02-4764-ab2c-3fb4af0f62c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127a036c-acd2-4297-82f5-1e41ca62c5bf", "name": "network-vif-deleted", "tag": "441ae9b5-dea2-4a36-a88f-505954308634"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:04.118456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:04.118456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:31:04.133274 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-c7258980-b964-4c76-a16d-3dc8c725f83b req-0221075c-ef02-4764-ab2c-3fb4af0f62c4 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.133274 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-c7258980-b964-4c76-a16d-3dc8c725f83b req-0221075c-ef02-4764-ab2c-3fb4af0f62c4 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.146397 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-c7258980-b964-4c76-a16d-3dc8c725f83b req-0221075c-ef02-4764-ab2c-3fb4af0f62c4 service nova] Creating event network-vif-deleted:441ae9b5-dea2-4a36-a88f-505954308634 for instance 127a036c-acd2-4297-82f5-1e41ca62c5bf on hv-cinder-82662 Jan 28 01:31:04.146759 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:04.148685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:04.151509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-c7258980-b964-4c76-a16d-3dc8c725f83b req-0221075c-ef02-4764-ab2c-3fb4af0f62c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039009 Jan 28 01:31:04.152290 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 399/806] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:31:04.172178 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.172626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.173596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.173901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.247945 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:04.259111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-49f3a0bd-bfff-4fe3-901f-666f8dc83234 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 200 len: 1225 microversion: 2.1 time: 0.117216 Jan 28 01:31:04.259781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 408/807] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:04 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:04.293330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:04.294342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:04.302425 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.302873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.303776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.304224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.410362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0182d081-dd15-4b46-a6f1-df01a7206256 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 36868 microversion: 2.20 time: 0.121551 Jan 28 01:31:04.411067 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 400/808] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:04 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 36868 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:04.607944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:04.609158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:04.620015 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.620842 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.622240 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:04.623037 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:04.781326 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:04.789994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d56f0982-ab7d-4450-9709-772c86fbec9e tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.187310 Jan 28 01:31:04.790593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 409/809] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:04 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:05.190239 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-f8d17d27-54e2-426c-983e-c7025b22e5e9 req-ddddf34a-4bf1-40ec-8bc9-9de88f1456dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302ed740-59cc-4ccb-91cb-afc413f1e537", "name": "network-vif-plugged", "status": "completed", "tag": "61e0d2b9-4634-4891-a557-49e0463271e2"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:05.191808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:05.191808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:31:05.201046 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-f8d17d27-54e2-426c-983e-c7025b22e5e9 req-ddddf34a-4bf1-40ec-8bc9-9de88f1456dc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.201683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-f8d17d27-54e2-426c-983e-c7025b22e5e9 req-ddddf34a-4bf1-40ec-8bc9-9de88f1456dc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:05.217734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-f8d17d27-54e2-426c-983e-c7025b22e5e9 req-ddddf34a-4bf1-40ec-8bc9-9de88f1456dc service nova] Creating event network-vif-plugged:61e0d2b9-4634-4891-a557-49e0463271e2 for instance 302ed740-59cc-4ccb-91cb-afc413f1e537 on hv-cinder-82662 Jan 28 01:31:05.227027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-f8d17d27-54e2-426c-983e-c7025b22e5e9 req-ddddf34a-4bf1-40ec-8bc9-9de88f1456dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145075 Jan 28 01:31:05.228654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 401/810] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:31:05.276685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:05.278396 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:05.284024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.284465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:05.285513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.285919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:05.302263 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] HTTP exception thrown: Instance 127a036c-acd2-4297-82f5-1e41ca62c5bf could not be found. Jan 28 01:31:05.303668 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Returning 404 to user: Instance 127a036c-acd2-4297-82f5-1e41ca62c5bf could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:31:05.304801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-29f941a4-330e-4cec-9402-743b39114c9c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 404 len: 111 microversion: 2.1 time: 0.031652 Jan 28 01:31:05.312290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 410/811] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:05 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:31:05.425024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:05.426994 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:05.427654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-623858784", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423439306", "security_groups": [{"name": "tempest-secgroup-smoke-180707503"}], "block_device_mapping_v2": [{"uuid": "b5b403a0-d7b7-4fa8-aeec-2828e53728e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73ebb25b-4b41-4be2-af3a-88e69f998b5e"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:05.435654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.436683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:05.437532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.441839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:05.596148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] validate_networks() for [('73ebb25b-4b41-4be2-af3a-88e69f998b5e', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:31:05.612749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f2ee48cf-05c7-4bb7-853f-5f6536bbf918 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 38017 microversion: 2.20 time: 0.193432 Jan 28 01:31:05.613977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 402/812] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:05 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 38017 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:05.808834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:05.809595 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:05.816890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.817372 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:05.818301 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:05.818739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:06.088316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:06.096304 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9bbf4382-8b7a-42d7-8fd0-35779f579b3d tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.291804 Jan 28 01:31:06.097551 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 403/813] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:05 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:06.138091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:31:06.138519 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:31:06.138958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:31:06.139364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:31:06.139776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:31:06.149916 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:06.150385 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:06.151250 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:06.151676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:06.173729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:31:06.178298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for user 6b11396acc67415abb08ddddf5680df8 and project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:31:06.258040 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:31:06.263177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5b403a0-d7b7-4fa8-aeec-2828e53728e1',volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:31:06.418245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5709a365-80e3-4ef4-927b-cf046130a98a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.994851 Jan 28 01:31:06.419347 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 411/814] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:31:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:31:06.435871 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a536768d-a8ef-4392-9388-28a8bad27e6c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:06.437173 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a536768d-a8ef-4392-9388-28a8bad27e6c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:06.511642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a536768d-a8ef-4392-9388-28a8bad27e6c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:06.520025 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a536768d-a8ef-4392-9388-28a8bad27e6c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1093 microversion: 2.1 time: 0.092965 Jan 28 01:31:06.520614 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 404/815] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:06 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:06.634165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:06.635860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:06.646099 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:06.647676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:06.648241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:06.649083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:06.795453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-99f83e3a-44ee-42fd-9fbd-27bdf29798d9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 38204 microversion: 2.20 time: 0.172487 Jan 28 01:31:06.799922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 412/816] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:06 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 38204 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:07.116620 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:07.117142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:07.124144 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:07.124563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:07.125395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:07.125824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:07.280724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:07.289301 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dbbcc39b-fee1-4a9a-bb91-fb5c0bcb8e39 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1319 microversion: 2.1 time: 0.176454 Jan 28 01:31:07.290221 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 405/817] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:07 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:07.538512 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:07.539328 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:07.547061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:07.547502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:07.548308 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:07.548741 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:07.615762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:07.627826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b26fedfd-2bd1-4fb8-9792-a233dd44cedc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1191 microversion: 2.1 time: 0.094059 Jan 28 01:31:07.628409 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 413/818] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:07 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:07.808597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:07.809484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:07.817344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:07.817844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:07.818638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:07.819054 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.016414 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-917125a5-de2c-435b-bac5-b0acef9eaba7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 38204 microversion: 2.20 time: 0.211693 Jan 28 01:31:08.017207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 406/819] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:07 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 38204 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:31:08.315728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:08.316802 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:08.338076 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:08.338857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.340532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:08.341128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.598918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:08.608500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-eceb5429-debe-4744-b784-1d1ee92b06c2 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1509 microversion: 2.1 time: 0.300025 Jan 28 01:31:08.609263 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 414/820] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:08 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:08.625937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2596f17-a7e3-4a95-a9b2-8853f23bc9fb", "device": "/dev/sdb"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:08.627140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:08.635369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:08.635814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.636633 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:08.637023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.646880 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:08.647649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:08.662027 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:08.662549 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.663354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:08.663790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:08.748960 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:08.760236 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-28f13b1a-6267-4011-87f7-98435298fff1 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1209 microversion: 2.1 time: 0.117247 Jan 28 01:31:08.761722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 415/821] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:08 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:08.997093 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-76381182-fe6a-4fd3-b47b-4202b2d90eb8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "POST /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375106 Jan 28 01:31:08.998066 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 407/822] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:31:08 2022] POST /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537/os-volume_attachments => generated 194 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:31:09.029586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:09.031231 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:09.042563 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.043268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.050486 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.051025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.185746 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8ee41d46-e8a6-4591-88f1-b5333b9fd02c tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 200 len: 38347 microversion: 2.20 time: 0.160436 Jan 28 01:31:09.187640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 416/823] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:09 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 38347 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:09.198491 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:09.199147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:09.206627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.207359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.208393 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.208882 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.234176 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4c9c23ba-d9ef-4ed3-aa97-b913efc4a1ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/ips" status: 200 len: 151 microversion: 2.20 time: 0.040168 Jan 28 01:31:09.234760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 408/824] 10.222.0.16 () {60 vars in 1288 bytes} [Fri Jan 28 01:31:09 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:31:09.785323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:09.786779 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:09.806276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.807451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.808865 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.809793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.865141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-66ecd0f5-e381-4e92-9fb8-4864a1aaa90e req-c0601e81-8ccb-45a4-b589-ff111187f206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6159fd6-8aec-48d1-a5bf-931de7eaabf0", "tag": "dd10330d-4479-4215-a738-88665cbe112f"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:09.867083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:09.867083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:31:09.886997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-66ecd0f5-e381-4e92-9fb8-4864a1aaa90e req-c0601e81-8ccb-45a4-b589-ff111187f206 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:09.887928 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-66ecd0f5-e381-4e92-9fb8-4864a1aaa90e req-c0601e81-8ccb-45a4-b589-ff111187f206 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:09.908815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-66ecd0f5-e381-4e92-9fb8-4864a1aaa90e req-c0601e81-8ccb-45a4-b589-ff111187f206 service nova] Creating event network-changed:dd10330d-4479-4215-a738-88665cbe112f for instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 on hv-cinder-82662 Jan 28 01:31:09.917067 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-66ecd0f5-e381-4e92-9fb8-4864a1aaa90e req-c0601e81-8ccb-45a4-b589-ff111187f206 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055195 Jan 28 01:31:09.919192 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 409/825] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:31:10.072835 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:10.081510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a6726ad1-6f06-48a3-808e-36f1e855676c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.300352 Jan 28 01:31:10.082193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 417/826] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:09 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:11.108663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:11.109460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:11.116410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:11.117075 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:11.117924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:11.118362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:11.265831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:11.274044 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cc2b0e42-9234-462e-b34c-9c434e2ff103 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.170844 Jan 28 01:31:11.274626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 410/827] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:11 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:11.349466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:11.350081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:11.356681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:11.357129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:11.357940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:11.358389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:11.386887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lazy-loading 'flavor' on Instance uuid 0c460d75-9b3c-4039-94e9-86867faebbbe {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:31:11.655825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-53da10e9-8452-4e53-b02b-a5d79643a492 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 202 len: 0 microversion: 2.20 time: 0.309794 Jan 28 01:31:11.656601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 418/828] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:11 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:31:11.666790 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:11.667542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:11.673935 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:11.674653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:11.675805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:11.676598 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:11.822649 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:11.833887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:11.835737 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:11.837707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c8b76776-73e9-4cf6-a621-5ec4d730e556 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.174406 Jan 28 01:31:11.838693 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 411/829] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:11 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:12.292341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:12.293081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:12.299859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:12.300318 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:12.301183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:12.301749 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:12.446488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:12.454826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0779a79d-b45a-4121-b064-1ff781016da4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.167336 Jan 28 01:31:12.455369 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 419/830] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:12 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:12.857513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:12.858114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:12.864889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:12.865364 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:12.866148 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:12.866580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:13.006135 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:13.014356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:13.015846 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:13.017350 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3e563a4a-a940-4164-a20f-c4428462d814 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.163463 Jan 28 01:31:13.017911 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 412/831] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:12 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:13.472054 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:13.472640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:13.479574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:13.480027 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:13.480816 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:13.481258 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:13.630888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:13.639509 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b43a0173-5ab0-4fdf-8d3d-41d237f57e50 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.171225 Jan 28 01:31:13.640081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 420/832] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:13 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:14.035908 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:14.036579 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:14.043652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:14.044040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:14.044826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:14.045286 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:14.193020 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:14.201218 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:14.203098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:14.204271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-aa5b7da8-ceb6-4eaf-87c8-56702fd363a0 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.172126 Jan 28 01:31:14.204816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 413/833] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:14 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:14.656689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:14.657555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:14.663924 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:14.664375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:14.665169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:14.665627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:14.799720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:14.807400 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9ed715d5-16b2-49d3-af3e-f84298a680df tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.154416 Jan 28 01:31:14.807985 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 421/834] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:14 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:15.221994 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:15.222715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:15.231040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:15.231833 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:15.232769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:15.233359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:15.377582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:15.386136 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:15.388097 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:15.389253 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cc2e8bb3-b5be-4d7b-bb0d-3c530014efc4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.171046 Jan 28 01:31:15.389796 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 414/835] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:15 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:15.825245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:15.826182 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:15.833666 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:15.834227 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:15.834979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:15.835419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:16.012521 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:16.021877 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-04bc85da-29b2-45b5-b594-936dfddf6610 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.201183 Jan 28 01:31:16.022449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 422/836] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:15 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:16.408491 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:16.409445 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:16.417078 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:16.417558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:16.418594 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:16.419038 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:16.586255 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:16.595541 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:16.597302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:16.598527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-370fc9f5-42f0-4970-bc01-4a780c26f6a2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.194160 Jan 28 01:31:16.599333 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 415/837] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:16 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:17.042089 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:17.042717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:17.049571 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:17.050019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:17.050806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:17.051235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:17.188823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:17.198211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5ad0683c-67d3-4777-b0c1-e6be716368dd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.159683 Jan 28 01:31:17.198798 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 423/838] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:17 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:17.625284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:17.626021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:17.633129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:17.633610 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:17.634403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:17.634864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:17.771602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:17.780063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:17.781572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:17.782764 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dfca33ce-856f-4315-82b3-8c5421f2603e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.161265 Jan 28 01:31:17.783328 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 416/839] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:17 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:18.215647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:18.216303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:18.223124 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:18.223578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:18.224371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:18.224878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:18.368907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:18.376826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2ab4327a-bb7a-48fe-900c-cf19809967e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.164791 Jan 28 01:31:18.377437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 424/840] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:18 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:18.801739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:18.802500 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:18.809012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:18.809494 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:18.810286 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:18.810722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:18.945657 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:18.954604 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:18.956098 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:18.957397 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7205501d-9373-4bb4-b1ea-870236c9c187 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.159365 Jan 28 01:31:18.957963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 417/841] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:18 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:31:19.393885 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:19.394514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:19.401246 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:19.401706 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:19.402493 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:19.402917 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:19.540474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:19.548469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6f3021ab-8015-4ed9-aaf1-31831b3573b2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.158170 Jan 28 01:31:19.549043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 425/842] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:19 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:19.977415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:19.978088 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:19.985999 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:19.986369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:19.987166 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:19.987601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:20.157958 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:20.166819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:20.168396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:20.169749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8d25947b-57b1-40cb-93d1-448b904b83b1 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.196718 Jan 28 01:31:20.170401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 418/843] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:19 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:20.565899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:20.566536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:20.579945 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:20.580401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:20.581198 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:20.581663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:20.742440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:20.752962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d3097078-5b9a-4118-87fd-2224e587ae58 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.190705 Jan 28 01:31:20.753722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 426/844] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:20 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:21.187904 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:21.188527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:21.196401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:21.197035 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:21.198052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:21.198588 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:21.344373 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:21.352663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:21.354181 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:21.355345 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b429eea8-aa3b-4658-b99b-cb28afa9ae31 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.171507 Jan 28 01:31:21.355912 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 419/845] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:21 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:21.772597 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:21.773415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:21.779899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:21.780348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:21.781145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:21.781611 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:21.926244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:21.934856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e159326e-ed99-40c4-b1d5-9df078ff3a49 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.166058 Jan 28 01:31:21.935467 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 427/846] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:21 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:22.374679 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:22.375274 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:22.382121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:22.382581 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:22.383376 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:22.383810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:22.524409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:22.532875 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:22.534388 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:22.535574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-495da5f0-274a-4b91-aa24-1e823e9e233f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.164825 Jan 28 01:31:22.536256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 420/847] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:22 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:22.953322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:22.953947 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:22.960814 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:22.961260 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:22.962078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:22.962506 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:23.123743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:23.137174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bc0a19d5-b522-4e38-b430-9a31cf3949d5 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.187535 Jan 28 01:31:23.138251 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 428/848] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:22 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:23.173948 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-56771971-6987-48f3-b449-2845b7731fad req-cee41c4f-0e47-4960-98b3-0ac36577e1bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6159fd6-8aec-48d1-a5bf-931de7eaabf0", "name": "network-vif-plugged", "status": "completed", "tag": "dd10330d-4479-4215-a738-88665cbe112f"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:23.176002 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:23.176002 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:31:23.183582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-56771971-6987-48f3-b449-2845b7731fad req-cee41c4f-0e47-4960-98b3-0ac36577e1bc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:23.183953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-56771971-6987-48f3-b449-2845b7731fad req-cee41c4f-0e47-4960-98b3-0ac36577e1bc service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:23.198514 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-56771971-6987-48f3-b449-2845b7731fad req-cee41c4f-0e47-4960-98b3-0ac36577e1bc service nova] Creating event network-vif-plugged:dd10330d-4479-4215-a738-88665cbe112f for instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 on hv-cinder-82662 Jan 28 01:31:23.213066 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-56771971-6987-48f3-b449-2845b7731fad req-cee41c4f-0e47-4960-98b3-0ac36577e1bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042706 Jan 28 01:31:23.213964 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 421/849] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:31:23.553487 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:23.554127 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:23.560791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:23.561262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:23.562074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:23.562510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:23.705763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:23.714180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:23.715684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:23.716857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-adc359d4-ba43-4e57-aa07-0781b6c707eb tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.167451 Jan 28 01:31:23.717469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 429/850] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:23 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:24.161782 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:24.162469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:24.170435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:24.170977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:24.171805 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:24.172294 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:24.667984 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:24.676360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-54e01ad2-3a6a-4ed0-a46f-7c5d6aa63771 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.519810 Jan 28 01:31:24.676934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 422/851] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:24 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:24.739072 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:24.741412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:24.751048 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:24.751787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:24.753158 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:24.753990 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:24.903271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:24.914072 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:24.916372 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:24.918268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f5e0e0f7-6b65-4b2a-b2e3-99ff0ecab720 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.186112 Jan 28 01:31:24.919130 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 430/852] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:24 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:25.693627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:25.694256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:25.701170 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:25.701692 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:25.702961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:25.703432 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:25.852625 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:25.860593 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8e8b8448-61de-4fe3-ba51-2108bc4e3453 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1264 microversion: 2.1 time: 0.170645 Jan 28 01:31:25.861176 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 423/853] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:25 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:25.940522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:25.941616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:25.952998 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:25.953834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:25.955296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:25.956129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:26.115495 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:26.124915 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:26.126453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:26.127620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e77040a3-edd0-4c90-92b7-9f61e3e5a3c2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.193670 Jan 28 01:31:26.128417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 431/854] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:25 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:26.880564 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:26.881423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:26.891257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:26.891940 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:26.893283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:26.893866 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:27.044593 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:27.052440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-61c18088-ed62-41f4-9131-260be63508e0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1451 microversion: 2.1 time: 0.177795 Jan 28 01:31:27.053011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 424/855] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:26 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:27.068644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:27.069279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:27.076128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:27.076633 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:27.077861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:27.078333 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:27.146446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:27.146956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:27.153314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:27.153762 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:27.154542 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:27.154995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:27.258732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:27.266837 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7a0441bc-8c51-4796-b925-2a6da3e8a6ce tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1451 microversion: 2.1 time: 0.201580 Jan 28 01:31:27.267854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 432/856] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:27 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1451 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:27.322093 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:27.330979 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:27.332559 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:27.333852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-660b0420-9f66-4440-ab2b-3ebb42bf9873 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.191569 Jan 28 01:31:27.334413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 425/857] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:27 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:28.352305 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:28.352980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:28.361573 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:28.362350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:28.363164 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:28.363596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:28.519086 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:28.525436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:28.526715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:28.534375 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:28.535024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:28.535278 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:28.537023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:28.537023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:28.537389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:28.538588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f73e8b6d-7a82-4d7f-b67f-86f4ca2343b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.190090 Jan 28 01:31:28.539157 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 433/858] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:28 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:28.708508 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lazy-loading 'services' on Instance uuid 302ed740-59cc-4ccb-91cb-afc413f1e537 {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:31:28.835821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dec9136a-96f1-497d-8489-e4b02055634f tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "DELETE /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537/os-volume_attachments/f2596f17-a7e3-4a95-a9b2-8853f23bc9fb" status: 202 len: 0 microversion: 2.1 time: 0.314089 Jan 28 01:31:28.836659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 426/859] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:31:28 2022] DELETE /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537/os-volume_attachments/f2596f17-a7e3-4a95-a9b2-8853f23bc9fb => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:29.563986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:29.564919 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:29.567903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-020482f2-5d04-488d-89eb-dc327203c076 req-69f1d6be-a6da-4ff8-87cc-ef8e17e0d044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6159fd6-8aec-48d1-a5bf-931de7eaabf0", "tag": "dd10330d-4479-4215-a738-88665cbe112f"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:29.572225 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:29.572225 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:31:29.573338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:29.573807 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:29.574628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:29.575242 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:29.584619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-020482f2-5d04-488d-89eb-dc327203c076 req-69f1d6be-a6da-4ff8-87cc-ef8e17e0d044 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:29.585153 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-020482f2-5d04-488d-89eb-dc327203c076 req-69f1d6be-a6da-4ff8-87cc-ef8e17e0d044 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:29.599691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-020482f2-5d04-488d-89eb-dc327203c076 req-69f1d6be-a6da-4ff8-87cc-ef8e17e0d044 service nova] Creating event network-changed:dd10330d-4479-4215-a738-88665cbe112f for instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 on hv-cinder-82662 Jan 28 01:31:29.609319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-020482f2-5d04-488d-89eb-dc327203c076 req-69f1d6be-a6da-4ff8-87cc-ef8e17e0d044 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146294 Jan 28 01:31:29.612316 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 434/860] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:31:29.776684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:29.790431 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:29.792483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:29.794124 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-811d1890-c0c6-4e67-86ff-f7b293e2c343 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1743 microversion: 2.20 time: 0.236984 Jan 28 01:31:29.796827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 427/861] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:29 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:30.821259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:30.821966 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:30.829621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:30.830077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:30.830891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:30.831336 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:31.018919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:31.039226 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:31.042482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:31.044719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5479343c-042c-4a4a-8b38-7cb5a6a44b54 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1743 microversion: 2.20 time: 0.229302 Jan 28 01:31:31.045805 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 435/862] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:30 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1743 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:31.061842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:31.062481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:31.069410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:31.069888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:31.070681 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:31.071078 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:31.098580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:31:31.199968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c311c1d7-fe54-40ac-a7e0-e6292bc916c8 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "DELETE /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 204 len: 0 microversion: 2.1 time: 0.141585 Jan 28 01:31:31.201012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 428/863] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:31:31 2022] DELETE /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:31:31.214896 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:31.215958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:31.223032 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:31.223579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:31.224391 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:31.224839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:31.388388 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:31.402553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5684ec94-c298-4dd9-b9be-28b2a7e656ac tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1515 microversion: 2.1 time: 0.195671 Jan 28 01:31:31.404196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 436/864] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:31 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:32.069273 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:32.071582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:32.094029 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:32.094938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:32.096050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:32.097116 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:32.312892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:32.321975 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:32.323748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:32.324904 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bf901d9d-2c26-4d1e-980d-42cf98a75522 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.262782 Jan 28 01:31:32.336520 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 429/865] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:32 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:32.390594 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:32.391469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:32.403317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:32.403939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:32.405189 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:32.405905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:32.431936 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:32.432607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:32.442403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:32.444448 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:32.454361 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:32.456364 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:32.536093 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lazy-loading 'services' on Instance uuid 66b5cb18-2b39-4a8d-9832-43a930270995 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:31:32.649537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8f194bc1-b8dd-4c51-b55a-82e2e1d3ade8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-volume_attachments/c1bbac77-6f22-4fb8-95e4-6fb0ebfe22de" status: 202 len: 0 microversion: 2.1 time: 0.262461 Jan 28 01:31:32.651576 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 437/866] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:31:32 2022] DELETE /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-volume_attachments/c1bbac77-6f22-4fb8-95e4-6fb0ebfe22de => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:32.701142 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:32.724652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7a353375-650c-4bf6-88ff-d00e8ec26ad5 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1515 microversion: 2.1 time: 0.297132 Jan 28 01:31:32.741135 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 430/867] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:32 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1515 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:33.349410 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:33.354465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:33.363585 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:33.364748 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:33.365721 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:33.365721 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:33.601651 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:33.612213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:33.614299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:33.615946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6830f7d5-df0e-41a4-9de1-836948c9a71b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.274576 Jan 28 01:31:33.617333 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 438/868] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:33 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:33.751821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:33.753389 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:33.766514 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:33.767001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:33.768701 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:33.770015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:34.012314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:34.026167 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7779d706-ab65-410d-8b62-2bf31c20dbf6 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1515 microversion: 2.1 time: 0.282363 Jan 28 01:31:34.027541 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 431/869] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:33 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1515 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:34.254256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-30ddda19-bd8f-481e-a9da-cf6275adf37d req-fbd125ed-ff18-4a4e-b56e-b021c6eff51c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "name": "network-vif-plugged", "status": "completed", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:34.256899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:34.256899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:31:34.277758 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-30ddda19-bd8f-481e-a9da-cf6275adf37d req-fbd125ed-ff18-4a4e-b56e-b021c6eff51c service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:34.278210 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-30ddda19-bd8f-481e-a9da-cf6275adf37d req-fbd125ed-ff18-4a4e-b56e-b021c6eff51c service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:34.307878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-30ddda19-bd8f-481e-a9da-cf6275adf37d req-fbd125ed-ff18-4a4e-b56e-b021c6eff51c service nova] Creating event network-vif-plugged:df468b4e-46d6-4769-9495-a4ac5d9a0e37 for instance 0c460d75-9b3c-4039-94e9-86867faebbbe on hv-cinder-82662 Jan 28 01:31:34.314589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-30ddda19-bd8f-481e-a9da-cf6275adf37d req-fbd125ed-ff18-4a4e-b56e-b021c6eff51c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066900 Jan 28 01:31:34.315838 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 439/870] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:31:34.638132 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:34.639230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:34.655396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:34.655846 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:34.657198 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:34.658496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:34.948727 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:34.962031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:34.963540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:34.964751 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3bc2c207-8335-47a8-963d-83e61e798340 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.333597 Jan 28 01:31:34.965337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 432/871] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:34 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:35.035466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c9b2c88f-7a2f-40c8-9ff0-2f750a44987d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:35.052233 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c9b2c88f-7a2f-40c8-9ff0-2f750a44987d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:35.052772 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c9b2c88f-7a2f-40c8-9ff0-2f750a44987d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:35.055927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:35.057627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:35.067138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:35.067869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:35.069815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:35.071081 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:35.080990 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c9b2c88f-7a2f-40c8-9ff0-2f750a44987d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Going to try to stop instance {{(pid=116162) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 28 01:31:35.168315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c9b2c88f-7a2f-40c8-9ff0-2f750a44987d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 202 len: 0 microversion: 2.1 time: 0.137913 Jan 28 01:31:35.169459 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 440/872] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:31:35 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:35.181165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:35.186002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:35.190356 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:35.191146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:35.191651 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:35.192374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:35.206466 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a9be47ecd648508ef952ebb42a300a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1700ad15ae3467494fdcc80ffd1a648', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:35.217794 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5c6d74a6-22ae-4226-a83b-a061b014e939 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 200 len: 1473 microversion: 2.1 time: 0.174774 Jan 28 01:31:35.218413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 433/873] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:35 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:35.234248 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-964caae9-05b1-497e-83f4-4d60debc8988 req-4e2a80c6-3fb5-486d-a50b-a881026b379e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302ed740-59cc-4ccb-91cb-afc413f1e537", "name": "network-vif-deleted", "tag": "61e0d2b9-4634-4891-a557-49e0463271e2"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:35.236371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:35.236371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:31:35.256463 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-964caae9-05b1-497e-83f4-4d60debc8988 req-4e2a80c6-3fb5-486d-a50b-a881026b379e service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:35.257223 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-964caae9-05b1-497e-83f4-4d60debc8988 req-4e2a80c6-3fb5-486d-a50b-a881026b379e service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:35.275277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-964caae9-05b1-497e-83f4-4d60debc8988 req-4e2a80c6-3fb5-486d-a50b-a881026b379e service nova] Creating event network-vif-deleted:61e0d2b9-4634-4891-a557-49e0463271e2 for instance 302ed740-59cc-4ccb-91cb-afc413f1e537 on hv-cinder-82662 Jan 28 01:31:35.281730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-964caae9-05b1-497e-83f4-4d60debc8988 req-4e2a80c6-3fb5-486d-a50b-a881026b379e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051047 Jan 28 01:31:35.283160 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 434/874] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:31:35.402823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:35.416387 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e5a0988c-0ace-4d78-94ea-ab402504a3a2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.239698 Jan 28 01:31:35.416982 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 441/875] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:35 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:35.990526 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:35.992415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:36.005627 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:36.006212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:36.007626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:36.008223 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:36.236870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:36.238539 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:36.239474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] [instance: 302ed740-59cc-4ccb-91cb-afc413f1e537] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:36.254593 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:36.256853 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:36.258066 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:36.258430 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-891b5371-4f46-45a2-9a02-97ec40d6d063 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.273772 Jan 28 01:31:36.269273 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 435/876] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:35 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:36.270081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:36.273149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:36.274162 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:36.291248 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] HTTP exception thrown: Instance 302ed740-59cc-4ccb-91cb-afc413f1e537 could not be found. Jan 28 01:31:36.292218 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] Returning 404 to user: Instance 302ed740-59cc-4ccb-91cb-afc413f1e537 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:31:36.293415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1f40b3f8-6ddc-4375-92fa-ca8746050de7 tempest-VolumesSnapshotTestJSON-637983087 tempest-VolumesSnapshotTestJSON-637983087-project] 10.222.0.16 "GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537" status: 404 len: 111 microversion: 2.1 time: 0.060819 Jan 28 01:31:36.297414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 442/877] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:36 2022] GET /compute/v2.1/servers/302ed740-59cc-4ccb-91cb-afc413f1e537 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:31:36.436562 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:36.437170 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:36.450844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:36.451795 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:36.454094 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:36.455169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:36.656454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:36.672318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7ec2349b-ad9d-419b-8321-fed7ec7f45c7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.240764 Jan 28 01:31:36.673940 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 436/878] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:36 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:37.280696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:37.282272 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:37.290610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:37.291803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:37.292915 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:37.293494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:37.468235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:37.480863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:37.483558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:37.486327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0641d054-653f-437a-881a-66ef69e38629 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.209279 Jan 28 01:31:37.487232 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 443/879] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:37 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:37.693402 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:37.694599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:37.705715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:37.706302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:37.709988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:37.709988 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:37.924072 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:37.941678 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f760926b-4619-4c02-883b-5ce4b0720a3f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.247607 Jan 28 01:31:37.942407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 437/880] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:37 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:38.508218 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:38.509895 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:38.519132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:38.520405 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:38.521679 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:38.522381 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:38.722825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:38.740035 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:38.744197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:38.746549 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c145aff5-ca40-4c41-9a9d-75f7ea2b8dfd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.242767 Jan 28 01:31:38.748237 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 444/881] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:38 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:31:38.962254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:38.963758 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:38.971378 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:38.972139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:38.973421 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:38.974021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:39.179269 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:39.188972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e9459363-63ca-4a7b-a61a-15223200c4fe tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.228943 Jan 28 01:31:39.188972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 438/882] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:38 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:39.772942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:39.774658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:39.786483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:39.787197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:39.788555 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:39.790935 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:39.978320 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:39.989457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:39.991137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:39.992397 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-22e8f868-59be-4af4-a990-feae471280ac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.228193 Jan 28 01:31:40.003079 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 445/883] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:39 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:40.207215 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:40.207862 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:40.216539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:40.217174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:40.218552 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:40.219258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:40.375745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:40.384394 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-aa65b4e3-1954-4e35-8d89-5d00602b7466 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.180655 Jan 28 01:31:40.385275 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 439/884] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:40 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:41.020380 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:41.021496 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:41.032835 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:41.033675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:41.034908 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:41.035625 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:41.247640 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:41.259913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:41.261489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:41.262688 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-600ae2ef-2498-44cf-af38-e3697e8f3fe4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1738 microversion: 2.20 time: 0.248914 Jan 28 01:31:41.263583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 446/885] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:41 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:41.405249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:41.406532 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:41.413515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:41.413947 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:41.414912 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:41.415509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:41.589912 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:41.601750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-973cceae-1954-4fd5-ade0-a352b6f9910d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.199838 Jan 28 01:31:41.602438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 440/886] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:41 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:42.295924 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:42.298442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:42.308916 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:42.309676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:42.310917 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:42.311632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:42.475298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:42.489370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:42.490870 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:42.492513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b7808b37-e93e-4031-90d2-ed41ef6acdde tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1720 microversion: 2.20 time: 0.203535 Jan 28 01:31:42.503434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 447/887] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:42 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:31:42.627642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:42.628558 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:42.636149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:42.636617 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:42.637476 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:42.637891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:42.873858 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:42.881800 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-81826634-0708-4ff9-a743-e016e69e8a1f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.258789 Jan 28 01:31:42.882378 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 441/888] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:42 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:43.511321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:43.511907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:43.518792 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:43.519237 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:43.520157 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:43.520598 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:43.670436 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:43.678985 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:43.682568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:43.682568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-42d1cd6a-e7f9-4e23-bebd-8f6429bd4a60 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1720 microversion: 2.20 time: 0.174161 Jan 28 01:31:43.682568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 448/889] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:43 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:31:43.904127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:43.905199 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:43.916277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:43.916926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:43.918267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:43.918982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:44.097203 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:44.106509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d1e071ee-4786-4b0a-aee5-be486b514557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.208029 Jan 28 01:31:44.107101 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 442/890] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:43 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:44.701586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:44.702854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:44.709558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:44.709958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:44.710744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:44.711179 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:44.860216 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:44.868697 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:44.870333 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:44.871482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-24942121-d9e7-404a-8080-7e2b34c5bbcc tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1720 microversion: 2.20 time: 0.173716 Jan 28 01:31:44.872036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 449/891] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:44 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:45.130949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:45.132971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:45.141598 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:45.142108 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:45.143050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:45.143544 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:45.291454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:45.299705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-eb159de8-ad6e-4ce0-b832-9fcd617adc59 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1679 microversion: 2.1 time: 0.174525 Jan 28 01:31:45.300515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 443/892] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:45 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:45.894036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:45.894980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:45.903677 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:45.904507 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:45.905334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:45.905772 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.043416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:46.054338 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:46.055812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:46.057079 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-40d77ade-675e-4822-8359-93181315b0c7 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1663 microversion: 2.20 time: 0.170626 Jan 28 01:31:46.057692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 450/893] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:45 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:46.077497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c87ca334-af5f-409b-9ef6-da3a5e71615f"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:46.078915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:46.086886 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.087334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.088116 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.088544 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.179781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-3f4c0549-6703-442a-9bdf-b07c513e6a92 req-31fc005e-fe17-402d-b083-f75eac76ec5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "name": "network-vif-unplugged", "status": "completed", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:46.181886 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:31:46.181886 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:31:46.192725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-3f4c0549-6703-442a-9bdf-b07c513e6a92 req-31fc005e-fe17-402d-b083-f75eac76ec5b service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.193386 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-3f4c0549-6703-442a-9bdf-b07c513e6a92 req-31fc005e-fe17-402d-b083-f75eac76ec5b service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.212478 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.compute.server_external_events [req-3f4c0549-6703-442a-9bdf-b07c513e6a92 req-31fc005e-fe17-402d-b083-f75eac76ec5b service nova] Unable to find a host for instance 0c460d75-9b3c-4039-94e9-86867faebbbe. Dropping event network-vif-unplugged {{(pid=116162) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 28 01:31:46.213801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-3f4c0549-6703-442a-9bdf-b07c513e6a92 req-31fc005e-fe17-402d-b083-f75eac76ec5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037884 Jan 28 01:31:46.214589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 451/894] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jan 28 01:31:46.316416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:46.317111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:46.323699 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.324152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.324942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.325408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.433630 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9f87969e-ffe5-404c-a1ba-e9ffea4b4c05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.359706 Jan 28 01:31:46.434586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 444/895] 10.222.0.16 () {62 vars in 1363 bytes} [Fri Jan 28 01:31:46 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:31:46.487899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:46.496134 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-088c35d0-0808-4b61-a24c-1caf8f60bbd6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1656 microversion: 2.1 time: 0.183542 Jan 28 01:31:46.497560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 452/896] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:46 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1656 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:46.512284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4b47e3b6-93bb-48db-bdb2-fb72f2b98bff tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:46.518401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4b47e3b6-93bb-48db-bdb2-fb72f2b98bff tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.518850 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4b47e3b6-93bb-48db-bdb2-fb72f2b98bff tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.549692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:46.550193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:46.556466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.556927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.557727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.558165 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.580840 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4b47e3b6-93bb-48db-bdb2-fb72f2b98bff tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Going to try to start instance {{(pid=116163) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 28 01:31:46.624473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4b47e3b6-93bb-48db-bdb2-fb72f2b98bff tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action" status: 202 len: 0 microversion: 2.1 time: 0.115772 Jan 28 01:31:46.625831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 445/897] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:31:46 2022] POST /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:31:46.634056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:46.634938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:46.645168 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.645921 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.646831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:46.647332 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:46.786853 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:46.794943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9ec8fffc-9343-4022-a655-73bce1975f11 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1665 microversion: 2.1 time: 0.164907 Jan 28 01:31:46.795498 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 446/898] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:46 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:47.812335 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:47.813033 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:47.819900 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:47.820346 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:47.821140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:47.821611 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:47.963483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:47.971113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ea3e0677-1e13-4f19-91a5-08d505a083ce tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1665 microversion: 2.1 time: 0.162594 Jan 28 01:31:47.971706 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 447/899] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:47 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:48.989589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:48.990431 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:48.998647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:48.999189 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:49.000170 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:49.000685 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:49.182108 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:49.190303 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c2b24553-f0b2-4f18-b2b1-bc10b795b176 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1665 microversion: 2.1 time: 0.205416 Jan 28 01:31:49.190908 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 448/900] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:48 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:49.572750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a6423e4f-e6a7-4698-8eb5-bdef88701d4e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-volume_attachments/c87ca334-af5f-409b-9ef6-da3a5e71615f" status: 202 len: 0 microversion: 2.20 time: 3.027563 Jan 28 01:31:49.573986 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 453/901] 10.222.0.16 () {60 vars in 1456 bytes} [Fri Jan 28 01:31:46 2022] DELETE /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-volume_attachments/c87ca334-af5f-409b-9ef6-da3a5e71615f => generated 0 bytes in 3030 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:31:49.642557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:31:49.642557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:49.649514 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:49.650128 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:49.650985 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:49.651416 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:49.848124 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-032c6729-644a-4172-b299-e7918e362437 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action" status: 202 len: 0 microversion: 2.20 time: 0.211139 Jan 28 01:31:49.849400 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 449/902] 10.222.0.16 () {62 vars in 1318 bytes} [Fri Jan 28 01:31:49 2022] POST /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:31:49.857783 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:49.858415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:49.865618 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:49.866025 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:49.867019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:49.867796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:50.131412 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:50.140981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:50.143127 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:50.144559 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6db36900-c6a2-4d69-a8e2-fa6d1c22fea2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1671 microversion: 2.20 time: 0.290568 Jan 28 01:31:50.145752 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 454/903] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:49 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1671 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:50.210520 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:50.211987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:50.221723 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:50.222518 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:50.223704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:50.224195 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:50.397724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:50.406711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4a724399-8193-4ea7-b1cd-94ad6c720b0f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1665 microversion: 2.1 time: 0.201972 Jan 28 01:31:50.407332 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 450/904] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:50 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1665 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:31:51.166808 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:51.167484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:51.174132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:51.174613 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:51.175409 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:51.175846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:51.429774 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:51.430467 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:51.437337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:51.437937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:51.438863 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:51.439411 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:51.690181 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:51.698670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:51.700348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:51.702352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ff3711a9-acac-4c6d-85aa-451433958a4a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.539160 Jan 28 01:31:51.702981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 455/905] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:51 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:51.730667 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:51.738769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-25b218eb-512a-4e25-8bc5-a7e9b62ff010 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1669 microversion: 2.1 time: 0.312794 Jan 28 01:31:51.739389 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 451/906] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:31:51 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1669 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:31:52.725489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:52.726105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:52.733475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:52.733984 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:52.735617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:52.736077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:52.921395 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:52.935902 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:52.938691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:52.940716 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1d07bb79-af20-44fa-989e-8f98d37ce635 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.220628 Jan 28 01:31:52.941696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 456/907] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:52 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:53.969574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:53.970244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:53.977140 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:53.977779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:53.978798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:53.979609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:54.148690 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:54.157709 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:54.159197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:54.160408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fe50b535-ed7d-4f18-9e9f-c3d8e444c462 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.194620 Jan 28 01:31:54.160982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 452/908] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:53 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:55.182887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:55.183860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:55.192208 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:55.192717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:55.193852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:55.194313 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:55.375239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:55.384730 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:55.386497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:55.387685 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-58f045af-5935-4892-82c2-9b6dc0e1eac9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.209498 Jan 28 01:31:55.388487 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 457/909] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:55 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:56.409414 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:56.410529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:56.420859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:56.421487 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:56.422515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:56.423171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:56.628546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:56.661410 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:56.664972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:56.667470 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-23bb0082-7460-4f53-8ac8-8f26a04d56fa tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.264169 Jan 28 01:31:56.670407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 453/910] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:56 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:31:57.690872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:57.691480 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:57.700082 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:57.700719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:57.702091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:57.702785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:57.885122 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:57.902947 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:57.906846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:57.910444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5a1f6535-b59a-4744-b121-d755487c32cd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.223269 Jan 28 01:31:57.911725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 458/911] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:57 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:31:58.943353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:31:58.944843 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:31:58.951242 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:58.952280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:58.953074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:31:58.953548 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:31:59.133360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:59.143985 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:59.145638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:31:59.146853 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ebfb3314-f5c6-4c1b-aa37-d6df3fe7e83f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.208163 Jan 28 01:31:59.147424 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 454/912] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:31:58 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:00.170262 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:00.171126 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:00.181057 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:00.181767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:00.182764 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:00.183281 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:00.378229 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:00.393472 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:00.402676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:00.405220 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-447d07c6-ef4c-4deb-89a3-4e908c70a12a tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.238554 Jan 28 01:32:00.406886 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 459/913] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:00 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:01.429117 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:01.430643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:01.439038 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:01.439590 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:01.440712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:01.441274 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:01.572312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:01.580646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:01.582157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:01.583373 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0baf1281-fb19-491c-9a85-60e7ca7e2bf2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.159279 Jan 28 01:32:01.583917 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 455/914] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:01 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:02.601557 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:02.602170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:02.609670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:02.609670 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:02.610085 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:02.610523 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:02.745384 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:02.754797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:02.756419 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:02.757729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e13b8c4c-72c1-4bf2-8da0-2d0f4152f67f tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.159971 Jan 28 01:32:02.758278 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 460/915] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:02 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:03.776651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:03.777281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:03.786038 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:03.786615 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:03.787453 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:03.787878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:04.207244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:04.217602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:04.219114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:04.220302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a34aee8c-28cf-4aa0-afd1-98f0267d3cac tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.447853 Jan 28 01:32:04.220911 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 456/916] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:03 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:05.238686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:05.239440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:05.245890 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:05.246339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:05.247123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:05.247554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:05.388602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:05.398028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:05.399708 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:05.401797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-636e969a-4e9e-46f4-9255-00d3698f4a1e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.166677 Jan 28 01:32:05.403038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 461/917] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:05 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:06.420750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:06.421405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:06.428435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:06.428918 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:06.429920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:06.430350 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:06.573791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:06.582566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:06.584090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:06.585267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0a6aeafd-ba9e-4a1f-9559-2d508d43dd0e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.168518 Jan 28 01:32:06.585868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 457/918] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:06 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:07.606761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:07.607675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:07.614222 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:07.614680 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:07.615484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:07.615919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:07.764727 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:07.773959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:07.775430 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:07.776592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-48308e58-8772-4701-a052-d0ac983aaa94 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.176392 Jan 28 01:32:07.777149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 462/919] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:07 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:08.794837 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:08.795475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:08.803050 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:08.803554 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:08.804338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:08.804930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:09.093505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:09.103573 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:09.105564 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:09.107229 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f72862f7-4727-442c-a79a-c2e3de4eea05 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.315963 Jan 28 01:32:09.107993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 458/920] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:08 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 28 01:32:09.118133 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-abeb194b-132b-43c3-b971-3e5f53464087 req-1af2dc14-4616-447f-9e75-b8b49e8b6168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "name": "network-vif-plugged", "status": "completed", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:09.118133 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:09.118133 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:32:09.124393 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-abeb194b-132b-43c3-b971-3e5f53464087 req-1af2dc14-4616-447f-9e75-b8b49e8b6168 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:09.125030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-abeb194b-132b-43c3-b971-3e5f53464087 req-1af2dc14-4616-447f-9e75-b8b49e8b6168 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:09.137223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-abeb194b-132b-43c3-b971-3e5f53464087 req-1af2dc14-4616-447f-9e75-b8b49e8b6168 service nova] Creating event network-vif-plugged:df468b4e-46d6-4769-9495-a4ac5d9a0e37 for instance 0c460d75-9b3c-4039-94e9-86867faebbbe on hv-cinder-82662 Jan 28 01:32:09.142995 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-abeb194b-132b-43c3-b971-3e5f53464087 req-1af2dc14-4616-447f-9e75-b8b49e8b6168 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031317 Jan 28 01:32:09.144348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 463/921] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:32:10.125174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:10.125924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:10.135265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:10.135712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:10.136504 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:10.136928 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:10.292742 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:10.306752 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:10.308884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:10.310193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d2d65b6a-ed8a-494d-849e-2a144eff51b4 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.188870 Jan 28 01:32:10.310750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 459/922] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:10 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:11.329844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:11.336415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:11.355291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:11.356000 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:11.356596 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:11.357034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:11.544778 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:11.556651 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:11.558174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:11.559558 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4e6fffdf-7b1f-4b60-b819-9e11e88581ab tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1729 microversion: 2.20 time: 0.234165 Jan 28 01:32:11.560354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 464/923] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:11 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:12.582361 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:12.583264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:12.591930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:12.592538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:12.593643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:12.594234 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:12.814216 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:12.825252 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:12.827874 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:12.830038 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7c72c04b-a52c-4c55-a001-8ae8a567dfd2 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1716 microversion: 2.20 time: 0.254102 Jan 28 01:32:12.831232 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 460/924] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:12 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1716 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:21.213939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:32:21.214556 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: Fri Jan 28 01:32:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Jan 28 01:32:21.320349 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-39642157-3dff-4e4a-9f73-79584c8a5a94 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Action: 'create', calling method: .version_select at 0x7f7e76d19820>, body: {"keypair": {"name": "tempest-TestShelveInstance-1299718019"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:21.336439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-39642157-3dff-4e4a-9f73-79584c8a5a94 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Getting quotas for project 842618ac233949f9bbd304fc37feff56. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:32:21.340442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-39642157-3dff-4e4a-9f73-79584c8a5a94 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Getting quotas for user 64e0bc6be0d64ad794b70b72e9ac551e and project 842618ac233949f9bbd304fc37feff56. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:32:21.838166 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-39642157-3dff-4e4a-9f73-79584c8a5a94 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Getting quotas for project 842618ac233949f9bbd304fc37feff56. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:32:21.844148 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-39642157-3dff-4e4a-9f73-79584c8a5a94 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Getting quotas for user 64e0bc6be0d64ad794b70b72e9ac551e and project 842618ac233949f9bbd304fc37feff56. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:32:21.865197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-39642157-3dff-4e4a-9f73-79584c8a5a94 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.751495 Jan 28 01:32:21.866354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 465/925] 10.222.0.16 () {60 vars in 1157 bytes} [Fri Jan 28 01:32:21 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:32.798951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:32.799943 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:32.806949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:32.807402 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:32.808222 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:32.808663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:32.840195 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9df68d10-c71d-4a34-8bdb-4386507b52f7 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045004 Jan 28 01:32:32.840772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 461/926] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:32:32 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:32:32.908830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:32.910186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:32.915669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:32.916091 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:32.916913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:32.917350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:32.947174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:32:33.034796 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bb58a6e3-2c37-4b0d-b57f-d2c81528e8ac tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 204 len: 0 microversion: 2.1 time: 0.129668 Jan 28 01:32:33.039102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 466/927] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:32:32 2022] DELETE /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:32:33.044688 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:33.045372 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:33.051778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:33.052232 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:33.053193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:33.053668 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:33.201320 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:33.209482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f309df65-9692-42c8-bfa2-a1b29f6cfb0b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1675 microversion: 2.1 time: 0.168344 Jan 28 01:32:33.210073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 462/928] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:33 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:34.236503 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:34.237333 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:34.244209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:34.244660 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:34.245531 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:34.245979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:34.400745 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:34.408791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d8f284f6-9451-4a44-8a9e-14d4530635a3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1675 microversion: 2.1 time: 0.176560 Jan 28 01:32:34.409500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 467/929] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:34 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:35.428836 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:35.429660 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:35.440365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:35.441103 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:35.442509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:35.443244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:35.650368 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:35.660798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ac52368b-4ec0-445b-b83d-97e45b0bd944 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1675 microversion: 2.1 time: 0.237778 Jan 28 01:32:35.661560 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 463/930] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:35 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:36.681891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:36.682500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:36.689554 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:36.690011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:36.690834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:36.691399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:36.770533 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:36.778197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d9aa2fa3-bc2d-42b1-8973-07fdc2c37d5a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 200 len: 1608 microversion: 2.1 time: 0.101433 Jan 28 01:32:36.778775 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 468/931] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:36 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 1608 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:36.905012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-32d75467-0858-4bdb-ba26-5a589e011c75 req-c03c1043-fb6b-4dbd-a849-1eea9945f542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66b5cb18-2b39-4a8d-9832-43a930270995", "name": "network-vif-deleted", "tag": "187a7e7e-fa5e-4e14-a711-a70e8a3165d3"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:36.908743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:36.908743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:32:36.922330 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-32d75467-0858-4bdb-ba26-5a589e011c75 req-c03c1043-fb6b-4dbd-a849-1eea9945f542 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:36.923588 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-32d75467-0858-4bdb-ba26-5a589e011c75 req-c03c1043-fb6b-4dbd-a849-1eea9945f542 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:36.942073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-32d75467-0858-4bdb-ba26-5a589e011c75 req-c03c1043-fb6b-4dbd-a849-1eea9945f542 service nova] Creating event network-vif-deleted:187a7e7e-fa5e-4e14-a711-a70e8a3165d3 for instance 66b5cb18-2b39-4a8d-9832-43a930270995 on hv-cinder-82662 Jan 28 01:32:36.953044 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-32d75467-0858-4bdb-ba26-5a589e011c75 req-c03c1043-fb6b-4dbd-a849-1eea9945f542 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058629 Jan 28 01:32:36.955031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 464/932] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:37.798065 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:37.798983 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:37.808475 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:37.808972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:37.810197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:37.810989 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:37.835627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] HTTP exception thrown: Instance 66b5cb18-2b39-4a8d-9832-43a930270995 could not be found. Jan 28 01:32:37.836616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Returning 404 to user: Instance 66b5cb18-2b39-4a8d-9832-43a930270995 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:32:37.837913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-12562f22-58ae-481a-9547-12f77a4db416 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 404 len: 111 microversion: 2.1 time: 0.044303 Jan 28 01:32:37.838849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 469/933] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:37 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:32:37.848171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-478ad0b1-cc60-40e3-bc10-3a60a7c629b4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '.version_select at 0x7f7e7f95fe50>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:37.873704 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-478ad0b1-cc60-40e3-bc10-3a60a7c629b4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392840431" status: 202 len: 0 microversion: 2.1 time: 0.029920 Jan 28 01:32:37.874300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 465/934] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jan 28 01:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392840431 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:32:38.679161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-95546d39-7d02-42cd-9355-713dfb64e704 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: .version_select at 0x7f7e76d35ca0>, body: {"keypair": {"name": "tempest-keypair-1768346326"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:38.693470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-95546d39-7d02-42cd-9355-713dfb64e704 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:32:38.697578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-95546d39-7d02-42cd-9355-713dfb64e704 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for user f02cd9096152479da885ead20d3ec061 and project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:32:39.014252 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-95546d39-7d02-42cd-9355-713dfb64e704 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:32:39.017883 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-95546d39-7d02-42cd-9355-713dfb64e704 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for user f02cd9096152479da885ead20d3ec061 and project 0639b703e727474d8b71d24f7709a813. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:32:39.031417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-95546d39-7d02-42cd-9355-713dfb64e704 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.356358 Jan 28 01:32:39.032003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 470/935] 10.222.0.16 () {60 vars in 1157 bytes} [Fri Jan 28 01:32:38 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:40.401901 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1775382363", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1299718019", "security_groups": [{"name": "tempest-secgroup-smoke-480984410"}], "networks": [{"uuid": "eb2129af-ed3a-40c6-a26c-3eae8cd4bc0c"}], "block_device_mapping_v2": [{"uuid": "fc9e2995-ecda-4407-b864-6ee290bc2f90", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:40.520764 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] validate_networks() for [('eb2129af-ed3a-40c6-a26c-3eae8cd4bc0c', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:32:40.563077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1016325187", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cd1bdde-3b03-46ba-9a57-34554b07975c"}], "security_groups": [{"name": "tempest-securitygroup--678275928"}], "key_name": "tempest-keypair-1768346326", "user_data": "}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:40.694938 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] validate_networks() for [('4cd1bdde-3b03-46ba-9a57-34554b07975c', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:32:41.140091 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:32:41.140538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:32:41.141006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:32:41.141458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:32:41.141862 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:32:41.152246 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:41.152682 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:41.153539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:41.153934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:41.170777 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Getting quotas for project 842618ac233949f9bbd304fc37feff56. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:32:41.175295 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Getting quotas for user 64e0bc6be0d64ad794b70b72e9ac551e and project 842618ac233949f9bbd304fc37feff56. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:32:41.243860 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:32:41.246334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fc9e2995-ecda-4407-b864-6ee290bc2f90',volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:32:41.285894 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:32:41.286317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:32:41.286821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:32:41.287241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:32:41.287683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:32:41.298483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:41.299024 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:41.299919 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:41.300578 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:41.318101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for project 0639b703e727474d8b71d24f7709a813. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:32:41.323321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Getting quotas for user f02cd9096152479da885ead20d3ec061 and project 0639b703e727474d8b71d24f7709a813. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:32:41.336846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:32:41.343120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:32:41.381454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-80de69e7-946a-4f5d-9c52-ec2b40e8f08b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.983905 Jan 28 01:32:41.382306 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 466/936] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:32:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:32:41.392207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-de955343-5f4b-4038-9b68-1691d86a6127 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:41.392858 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-de955343-5f4b-4038-9b68-1691d86a6127 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:41.395953 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-39ac9bd1-ea8e-41e4-a3c0-f32cad63b9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.839929 Jan 28 01:32:41.396854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 471/937] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:32:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 28 01:32:41.413928 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2c4bcdf8-01c8-44cc-9cae-1b388f8f60f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:41.414539 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2c4bcdf8-01c8-44cc-9cae-1b388f8f60f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:41.461635 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-de955343-5f4b-4038-9b68-1691d86a6127 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:41.472971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-de955343-5f4b-4038-9b68-1691d86a6127 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1089 microversion: 2.1 time: 0.080711 Jan 28 01:32:41.483620 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 467/938] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:41 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1089 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:41.533202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2c4bcdf8-01c8-44cc-9cae-1b388f8f60f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:41.543849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2c4bcdf8-01c8-44cc-9cae-1b388f8f60f5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1238 microversion: 2.1 time: 0.134713 Jan 28 01:32:41.544831 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 472/939] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:41 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:42.490106 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:42.490705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:42.498433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:42.498845 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:42.499659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:42.500062 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:42.566199 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:42.567647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:42.567775 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:42.576244 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7c3396fa-170b-4509-b023-b4bfc0293fe1 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1187 microversion: 2.1 time: 0.089380 Jan 28 01:32:42.576993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 468/940] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:42 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1187 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:42.582653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:42.583295 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:42.584639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:42.585078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:42.670096 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:42.679428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9935a249-16b8-4fe9-8555-0b790172f287 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1290 microversion: 2.1 time: 0.121012 Jan 28 01:32:42.680046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 473/941] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:42 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:43.603203 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:43.603819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:43.616031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:43.616031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:43.616660 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:43.617601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:43.702436 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:43.703439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:43.704230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:43.713672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d635d569-94a8-4630-8adf-8b4d52e56475 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1205 microversion: 2.1 time: 0.121883 Jan 28 01:32:43.714553 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 469/942] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:43 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1205 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:43.723888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:43.723888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:43.723888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:43.725167 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:43.811425 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:43.819797 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-70089368-17ec-40db-be55-9856bbafaf79 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1296 microversion: 2.1 time: 0.121083 Jan 28 01:32:43.820883 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 474/943] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:43 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:44.730872 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:44.731468 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:44.737993 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:44.738440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:44.739234 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:44.739660 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:44.838441 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:44.838983 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:44.845465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:44.845918 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:44.846717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:44.847193 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:45.201052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:45.209349 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-40cd0578-62bd-4c95-9bf4-621027d040ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.482064 Jan 28 01:32:45.219281 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 470/944] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:44 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:45.293366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:45.301659 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-de58be9c-ff5b-4465-855c-922b6df3008b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.466890 Jan 28 01:32:45.302581 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 475/945] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:44 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:45.748782 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-7f8652d3-cbb5-46ef-bc89-23de083844fe req-ceb7ebd2-2e06-4c50-9326-c241f3e0f481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:45.751920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:45.751920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:32:45.763401 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-7f8652d3-cbb5-46ef-bc89-23de083844fe req-ceb7ebd2-2e06-4c50-9326-c241f3e0f481 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:45.763859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-7f8652d3-cbb5-46ef-bc89-23de083844fe req-ceb7ebd2-2e06-4c50-9326-c241f3e0f481 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:45.777384 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-7f8652d3-cbb5-46ef-bc89-23de083844fe req-ceb7ebd2-2e06-4c50-9326-c241f3e0f481 service nova] Creating event network-changed:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:32:45.793132 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-7f8652d3-cbb5-46ef-bc89-23de083844fe req-ceb7ebd2-2e06-4c50-9326-c241f3e0f481 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060986 Jan 28 01:32:45.798529 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 471/946] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:46.226623 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:46.227245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:46.234194 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:46.239443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:46.239443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:46.239443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:46.320956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:46.321899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:46.328915 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:46.329388 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:46.330184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:46.330618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:46.674591 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:46.682587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ea73edc2-5a1f-48c0-824e-2178275bc0bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.459646 Jan 28 01:32:46.683382 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 476/947] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:46 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:46.712486 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:46.721184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1d862571-4776-4d50-b2c2-30d4a550dc58 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.404128 Jan 28 01:32:46.722116 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 472/948] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:46 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:47.699409 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:47.700015 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:47.707191 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:47.707650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:47.708472 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:47.708910 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:47.741111 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:47.741747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:47.749673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:47.750147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:47.750934 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:47.751386 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:47.920374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:47.928568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-213b5811-d9a4-4435-8bce-063af95327fc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.232992 Jan 28 01:32:47.929344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 477/949] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:47 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:47.933903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-719421fb-7277-48bb-8415-c9f945165779 req-47979b36-cb53-4467-92d3-d1a32a9c1a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5475dd5f-267e-4bff-b143-07ec67f2acf2", "tag": "14540d13-5f10-4707-bda7-17d4c9430211"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:47.935510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:47.935510 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:32:47.942987 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-719421fb-7277-48bb-8415-c9f945165779 req-47979b36-cb53-4467-92d3-d1a32a9c1a8e service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:47.943425 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-719421fb-7277-48bb-8415-c9f945165779 req-47979b36-cb53-4467-92d3-d1a32a9c1a8e service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:47.955731 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-719421fb-7277-48bb-8415-c9f945165779 req-47979b36-cb53-4467-92d3-d1a32a9c1a8e service nova] Creating event network-changed:14540d13-5f10-4707-bda7-17d4c9430211 for instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 on hv-cinder-82662 Jan 28 01:32:47.960859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-719421fb-7277-48bb-8415-c9f945165779 req-47979b36-cb53-4467-92d3-d1a32a9c1a8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030331 Jan 28 01:32:47.961981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 478/950] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:47.963707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:47.971718 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4cc16d94-8af9-4746-80be-16fbd77a5b83 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.234278 Jan 28 01:32:47.972406 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 473/951] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:47 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:48.949211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:48.950045 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:48.957477 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:48.957911 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:48.958701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:48.959132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:48.988024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:48.988630 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:48.996721 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:48.997171 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:48.997989 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:48.998412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:49.136080 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:49.144071 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31b2f796-4157-431f-8b4e-109e0676d481 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.199846 Jan 28 01:32:49.144765 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 479/952] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:48 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:49.182937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:49.190899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9febc5d2-750c-4e95-bfab-0412d487d6b0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.206580 Jan 28 01:32:49.191481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 474/953] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:48 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:50.163101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:50.163746 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:50.169774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:50.170230 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:50.171030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:50.171469 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:50.207147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:50.208144 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:50.216829 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:50.217312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:50.218267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:50.218729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:50.359214 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:50.368354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c3e39dfb-2dbb-451d-891c-3e408fc78bcf tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.210589 Jan 28 01:32:50.369095 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 480/954] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:50 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:50.407059 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:50.414840 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a38663e5-a153-473d-a99b-c96b24a8b347 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.211270 Jan 28 01:32:50.415343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 475/955] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:50 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:51.337940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-e4ce4987-c27a-40c3-b481-46f63772d161 req-55527ce1-be79-4c2b-8985-3d403b79f3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5475dd5f-267e-4bff-b143-07ec67f2acf2", "name": "network-vif-plugged", "status": "completed", "tag": "14540d13-5f10-4707-bda7-17d4c9430211"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:51.339559 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:51.339559 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:32:51.346801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e4ce4987-c27a-40c3-b481-46f63772d161 req-55527ce1-be79-4c2b-8985-3d403b79f3b3 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:51.347273 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-e4ce4987-c27a-40c3-b481-46f63772d161 req-55527ce1-be79-4c2b-8985-3d403b79f3b3 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:51.360780 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-e4ce4987-c27a-40c3-b481-46f63772d161 req-55527ce1-be79-4c2b-8985-3d403b79f3b3 service nova] Creating event network-vif-plugged:14540d13-5f10-4707-bda7-17d4c9430211 for instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 on hv-cinder-82662 Jan 28 01:32:51.369286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-e4ce4987-c27a-40c3-b481-46f63772d161 req-55527ce1-be79-4c2b-8985-3d403b79f3b3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Jan 28 01:32:51.369286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 481/956] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:51.387328 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:51.387949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:51.394712 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:51.395165 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:51.395950 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:51.396380 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:51.432259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:51.433043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:51.439474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:51.440005 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:51.440935 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:51.441473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:51.579226 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:51.588176 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8b1fa15d-0298-4b3c-a47b-37eb71373e1b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.204529 Jan 28 01:32:51.589272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 476/957] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:51 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:51.654082 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:51.664637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8a3cbcae-0374-423d-a371-92762bd83968 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.235991 Jan 28 01:32:51.665247 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 482/958] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:51 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:52.611303 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:52.611906 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:52.619493 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:52.619930 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:52.620744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:52.621200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:52.682735 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:52.684001 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:52.689799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:52.690228 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:52.691046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:52.691474 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:52.824862 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:52.834566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cf1c8fb9-6b33-4e0f-882e-eec989e00ca4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.227000 Jan 28 01:32:52.835157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 477/959] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:52 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:52.886934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:52.895245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-404c8a81-eef6-4c28-accd-99b0992e8f3b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1363 microversion: 2.1 time: 0.217290 Jan 28 01:32:52.896609 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 483/960] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:52 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:53.851949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:53.852524 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:53.859209 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:53.859659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:53.860450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:53.860881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:53.913401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:53.914021 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:53.922022 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:53.922620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:53.923671 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:53.924257 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.029841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:54.037881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0e1509b7-bd14-4912-a949-467135e9c416 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.189712 Jan 28 01:32:54.038537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 478/961] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:53 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:54.095451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:54.103646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-209f602f-ca6e-4956-b516-58aa50a8a280 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1549 microversion: 2.1 time: 0.194211 Jan 28 01:32:54.104144 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 484/962] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:53 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:54.119940 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:54.120461 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:54.127040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.127497 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.128334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.128775 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.213395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ba735e6d-7a0b-49b7-865f-83bb0dcbd35a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097100 Jan 28 01:32:54.213986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 479/963] 10.222.0.16 () {58 vars in 1274 bytes} [Fri Jan 28 01:32:54 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:54.706697 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:54.707674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:54.714593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.715323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.716222 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.716655 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.748931 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-aa7c405c-d6fc-4567-9f8c-e35df2abc0dd tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046883 Jan 28 01:32:54.754944 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 485/964] 10.222.0.16 () {60 vars in 1342 bytes} [Fri Jan 28 01:32:54 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:54.822629 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:54.823131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:54.830069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.830540 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.831437 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.831877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.857177 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:32:54.949126 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-65489864-2ca1-4558-a843-862d9958cfcf tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 204 len: 0 microversion: 2.20 time: 0.129181 Jan 28 01:32:54.950778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 480/965] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jan 28 01:32:54 2022] DELETE /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 28 01:32:54.963743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:54.964363 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:54.970787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.971243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:54.972067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:54.972548 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:55.064468 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:55.065793 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:55.073417 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:55.073938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:55.074776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:55.075185 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:55.274706 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:55.284645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:55.286591 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:55.289522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f8fdaf32-d1d9-4e8e-8677-438aa1b39832 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.330143 Jan 28 01:32:55.289522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 486/966] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:54 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:55.380409 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:55.381528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:55.390128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:55.390701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:55.391562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:55.392366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:55.396480 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:55.409143 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6af279f7-1999-474b-b205-d42ff4693827 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.355834 Jan 28 01:32:55.410440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 481/967] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:55 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:55.417638 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-48332cd1-5c23-40b1-bb82-c8f163e6e034 req-7ffd25ea-edfc-4dc9-949b-5235eaaba9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5475dd5f-267e-4bff-b143-07ec67f2acf2", "tag": "14540d13-5f10-4707-bda7-17d4c9430211"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:55.417945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:55.417945 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:32:55.426800 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-48332cd1-5c23-40b1-bb82-c8f163e6e034 req-7ffd25ea-edfc-4dc9-949b-5235eaaba9fe service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:55.427431 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-48332cd1-5c23-40b1-bb82-c8f163e6e034 req-7ffd25ea-edfc-4dc9-949b-5235eaaba9fe service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:55.445876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-48332cd1-5c23-40b1-bb82-c8f163e6e034 req-7ffd25ea-edfc-4dc9-949b-5235eaaba9fe service nova] Creating event network-changed:14540d13-5f10-4707-bda7-17d4c9430211 for instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 on hv-cinder-82662 Jan 28 01:32:55.452971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-48332cd1-5c23-40b1-bb82-c8f163e6e034 req-7ffd25ea-edfc-4dc9-949b-5235eaaba9fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040842 Jan 28 01:32:55.454069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 482/968] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:55.572003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5f25dd4a-9fc1-407e-a75a-9214d6266046 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.196059 Jan 28 01:32:55.573544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 487/969] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:32:55 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:32:56.308717 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:56.309451 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:56.315582 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:56.316048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:56.316801 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:56.317641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:56.433138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:56.434615 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:56.445553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:56.446369 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:56.447742 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:56.448741 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:56.491430 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:56.501893 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:56.503545 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:56.504743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d8ad4baf-2c27-4e6d-8ea9-664c3041f675 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.200733 Jan 28 01:32:56.505337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 483/970] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:56 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:56.590565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:56.592597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:56.604208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:56.605487 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:56.606786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:56.607482 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:56.641940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:56.650582 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ccbbba4e-791b-4ed1-bcb4-6f58c6eee56c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.222981 Jan 28 01:32:56.655294 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 488/971] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:56 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:32:56.728043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6d2a80f0-f33c-4ecb-b41e-abf6d103722a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.144622 Jan 28 01:32:56.732159 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 484/972] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:32:56 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:32:57.523807 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:57.524401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:57.530691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:57.531146 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:57.531927 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:57.532361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:57.670087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:57.670737 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:57.678031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:57.678483 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:57.679284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:57.679714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:57.778869 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:57.787330 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:57.788813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3cd1ffeab8d74519a9b0d2d202e1cf6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33608c07529f42299cd9ae077624ebdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:57.790028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a85a424b-1773-4f06-8636-78d07eb95585 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 200 len: 1722 microversion: 2.20 time: 0.269969 Jan 28 01:32:57.790573 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 489/973] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:57 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 28 01:32:57.794867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:57.795813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:57.802733 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:57.803183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:57.803994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:57.804425 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:57.891058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-acfeb31a-e754-4f5d-ab2a-869a3708d8ae tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.099235 Jan 28 01:32:57.891747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 490/974] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:32:57 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:32:57.917669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:57.926926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-27f311ba-0baf-40a9-b181-6ac0802f8743 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.261119 Jan 28 01:32:57.927509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 485/975] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:57 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:58.183679 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-7ad806f7-7a68-4f20-b04e-522467f839ae req-a69facf1-39d6-4ac4-babd-c1b8114e4c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c460d75-9b3c-4039-94e9-86867faebbbe", "name": "network-vif-deleted", "tag": "df468b4e-46d6-4769-9495-a4ac5d9a0e37"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:58.185587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:58.185587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:32:58.194573 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-7ad806f7-7a68-4f20-b04e-522467f839ae req-a69facf1-39d6-4ac4-babd-c1b8114e4c88 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.195307 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-7ad806f7-7a68-4f20-b04e-522467f839ae req-a69facf1-39d6-4ac4-babd-c1b8114e4c88 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:58.209378 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-7ad806f7-7a68-4f20-b04e-522467f839ae req-a69facf1-39d6-4ac4-babd-c1b8114e4c88 service nova] Creating event network-vif-deleted:df468b4e-46d6-4769-9495-a4ac5d9a0e37 for instance 0c460d75-9b3c-4039-94e9-86867faebbbe on hv-cinder-82662 Jan 28 01:32:58.215868 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-7ad806f7-7a68-4f20-b04e-522467f839ae req-a69facf1-39d6-4ac4-babd-c1b8114e4c88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036484 Jan 28 01:32:58.217299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 491/976] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:32:58.808102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:58.808653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:58.815655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.816172 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:58.817255 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.817761 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:58.831780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] HTTP exception thrown: Instance 0c460d75-9b3c-4039-94e9-86867faebbbe could not be found. Jan 28 01:32:58.832366 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Returning 404 to user: Instance 0c460d75-9b3c-4039-94e9-86867faebbbe could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:32:58.833188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-07ab7294-4d40-405d-b602-f6a0ddcb013e tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 404 len: 111 microversion: 2.20 time: 0.029037 Jan 28 01:32:58.833752 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 486/977] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:32:58 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:32:58.843369 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-89d0b4e1-7212-4f0b-b8f1-b6b8b95f58b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '.version_select at 0x7f7e76dfdb80>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:58.863669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-89d0b4e1-7212-4f0b-b8f1-b6b8b95f58b5 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511037946" status: 204 len: 0 microversion: 2.20 time: 0.024665 Jan 28 01:32:58.864243 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 492/978] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Jan 28 01:32:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511037946 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 28 01:32:58.902354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:58.903395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:58.910765 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.911224 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:58.912052 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.912490 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:58.944170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:32:58.945195 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:32:58.954213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.954946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:58.955753 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:58.956225 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:59.021461 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8fb61a3a-a8dd-48fc-9ecd-e3615ed7d735 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.122620 Jan 28 01:32:59.024185 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 487/979] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:32:58 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:32:59.139234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:32:59.151543 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d379a8f5-c412-4e8e-b42f-c2abf0ee9d84 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.211392 Jan 28 01:32:59.152132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 493/980] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:32:58 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:32:59.385647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-8f164ccd-84af-4640-a931-9b1d597871be req-111c2e1b-af65-4226-8e35-89607cdd2135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "name": "network-vif-plugged", "status": "completed", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:32:59.387272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:32:59.387272 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:32:59.396827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-8f164ccd-84af-4640-a931-9b1d597871be req-111c2e1b-af65-4226-8e35-89607cdd2135 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:32:59.397398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-8f164ccd-84af-4640-a931-9b1d597871be req-111c2e1b-af65-4226-8e35-89607cdd2135 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:32:59.409510 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-8f164ccd-84af-4640-a931-9b1d597871be req-111c2e1b-af65-4226-8e35-89607cdd2135 service nova] Creating event network-vif-plugged:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:32:59.414679 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-8f164ccd-84af-4640-a931-9b1d597871be req-111c2e1b-af65-4226-8e35-89607cdd2135 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Jan 28 01:32:59.415806 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 488/981] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:00.033843 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:00.035117 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:00.043486 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.044104 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.044988 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.045513 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.151223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0c2d942d-8f17-4f70-bd5e-c11f7bde6f00 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.121745 Jan 28 01:33:00.151887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 494/982] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:00 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:33:00.169222 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:00.170027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:00.177407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.177937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.178720 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.179146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.328971 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:00.336702 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c50e35e1-017b-40f7-b68d-bb3e31333173 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1260 microversion: 2.1 time: 0.171949 Jan 28 01:33:00.337420 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 489/983] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:00 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:00.792771 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:00.793426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:00.800812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.801264 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.802061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.802494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.817404 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] HTTP exception thrown: Instance 0c460d75-9b3c-4039-94e9-86867faebbbe could not be found. Jan 28 01:33:00.818022 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Returning 404 to user: Instance 0c460d75-9b3c-4039-94e9-86867faebbbe could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:33:00.818873 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cfa73346-1e4b-4736-a096-b68d243b5740 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 404 len: 111 microversion: 2.20 time: 0.030252 Jan 28 01:33:00.819465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 495/984] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jan 28 01:33:00 2022] DELETE /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:33:00.828402 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:00.829034 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: 0c460d75-9b3c-4039-94e9-86867faebbbe] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:00.836192 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.836633 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.837462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:00.837888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:00.855071 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] HTTP exception thrown: Instance 0c460d75-9b3c-4039-94e9-86867faebbbe could not be found. Jan 28 01:33:00.855707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Returning 404 to user: Instance 0c460d75-9b3c-4039-94e9-86867faebbbe could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:33:00.856870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-04ac08cd-617c-4dfc-a28f-ad0eedfa6fa9 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe" status: 404 len: 111 microversion: 2.20 time: 0.032557 Jan 28 01:33:00.857762 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 490/985] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:33:00 2022] GET /compute/v2.1/servers/0c460d75-9b3c-4039-94e9-86867faebbbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:33:01.162480 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:01.163384 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:01.170221 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:01.170702 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:01.171511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:01.171961 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:01.261066 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fc8584d5-3c8d-42d6-9bcf-269197c193d0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.102113 Jan 28 01:33:01.261876 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 496/986] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:01 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:33:01.353566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:01.354188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:01.362903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:01.363740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:01.366481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:01.366481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:01.500084 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:01.507687 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5dbf7285-e041-4f23-9ab2-76855efa0518 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1444 microversion: 2.1 time: 0.157986 Jan 28 01:33:01.508254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 491/987] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:01 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:01.525500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:01.526249 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:01.533140 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:01.533623 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:01.534394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:01.534824 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:01.670322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:01.678276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9ed1f565-40a8-4ffa-9b16-b950086fa969 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1444 microversion: 2.1 time: 0.156880 Jan 28 01:33:01.678862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 497/988] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:01 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:02.027119 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:02.027939 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:02.034982 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:02.035423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:02.036210 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:02.036637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:02.051473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] HTTP exception thrown: Instance ee84016d-9001-4252-b16e-a4c1a7999a5a could not be found. Jan 28 01:33:02.052073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Returning 404 to user: Instance ee84016d-9001-4252-b16e-a4c1a7999a5a could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:33:02.053015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6bb0aa55-c10b-4ac2-936a-11e9da619642 tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 404 len: 111 microversion: 2.20 time: 0.029661 Jan 28 01:33:02.053614 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 492/989] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Jan 28 01:33:02 2022] DELETE /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:33:02.061815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:02.062430 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] [instance: ee84016d-9001-4252-b16e-a4c1a7999a5a] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:02.069270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:02.069738 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:02.070552 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:02.070992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:02.086077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] HTTP exception thrown: Instance ee84016d-9001-4252-b16e-a4c1a7999a5a could not be found. Jan 28 01:33:02.086679 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] Returning 404 to user: Instance ee84016d-9001-4252-b16e-a4c1a7999a5a could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:33:02.087515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6e90f663-6fbf-4477-805a-f5e9698f6f5b tempest-AttachVolumeShelveTestJSON-43553910 tempest-AttachVolumeShelveTestJSON-43553910-project] 10.222.0.16 "GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a" status: 404 len: 111 microversion: 2.20 time: 0.029576 Jan 28 01:33:02.088111 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 498/990] 10.222.0.16 () {60 vars in 1276 bytes} [Fri Jan 28 01:33:02 2022] GET /compute/v2.1/servers/ee84016d-9001-4252-b16e-a4c1a7999a5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 28 01:33:02.272311 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:02.273341 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:02.279618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:02.280182 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:02.281070 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:02.281600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:02.395732 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-06b407e4-a7bf-4cba-b477-a3c7941a66e4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.126674 Jan 28 01:33:02.396847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 493/991] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:02 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:33:03.412360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:03.418638 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:03.427402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:03.428209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:03.429319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:03.430136 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:03.536655 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-de7f2e3a-e186-4535-835c-5310b9d4a601 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.132148 Jan 28 01:33:03.539851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 499/992] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:03 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:33:03.826164 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-ac2911a1-352d-4ad6-9a6b-0b9e68ac0c7b req-f638fa52-c268-4996-bc39-c1119464fe45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:03.827877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:33:03.827877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:33:03.839172 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ac2911a1-352d-4ad6-9a6b-0b9e68ac0c7b req-f638fa52-c268-4996-bc39-c1119464fe45 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:03.839884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-ac2911a1-352d-4ad6-9a6b-0b9e68ac0c7b req-f638fa52-c268-4996-bc39-c1119464fe45 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:03.852088 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-ac2911a1-352d-4ad6-9a6b-0b9e68ac0c7b req-f638fa52-c268-4996-bc39-c1119464fe45 service nova] Creating event network-changed:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:33:03.858697 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-ac2911a1-352d-4ad6-9a6b-0b9e68ac0c7b req-f638fa52-c268-4996-bc39-c1119464fe45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042301 Jan 28 01:33:03.859942 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 494/993] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:04.548389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:04.550282 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:04.557875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:04.558473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:04.559370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:04.559913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:04.664254 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4935e6c8-9584-4587-bd46-ed31b225ee44 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.119915 Jan 28 01:33:04.664955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 500/994] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:04 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:33:05.683840 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:05.685613 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:05.693546 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:05.694245 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:05.695227 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:05.695818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:05.796780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6092d214-e5af-4e9e-8226-3093590abd29 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 14 microversion: 2.1 time: 0.124494 Jan 28 01:33:05.799967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 495/995] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:05 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:33:06.809514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:06.812566 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:06.823301 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:06.823747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:06.824562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:06.825097 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:06.951456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0cf9ba20-9dea-4cb9-8f7b-239db85300a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 4147 microversion: 2.1 time: 0.145217 Jan 28 01:33:06.953399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 501/996] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:06 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 4147 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:07.963458 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:07.964466 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:07.971819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:07.972299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:07.973212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:07.973669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:08.074927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bfc84106-e22d-4a54-8d2b-a85075cde09f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 12882 microversion: 2.1 time: 0.115402 Jan 28 01:33:08.075961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 496/997] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:07 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 12882 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:33:09.087405 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:09.088417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:09.095128 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:09.095574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:09.096363 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:09.096790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:09.205119 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b778b932-1fa4-4b51-b053-15e5750baeba tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 18356 microversion: 2.1 time: 0.121767 Jan 28 01:33:09.206001 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 502/998] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:09 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 18356 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:10.217509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:10.218509 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:10.225779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:10.226225 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:10.227000 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:10.227435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:10.316137 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b091d747-5454-4c9b-b9e4-020d5b2adc56 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 18356 microversion: 2.1 time: 0.102510 Jan 28 01:33:10.316893 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 497/999] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:10 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 18356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:11.328934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:11.330014 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:11.338070 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:11.338522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:11.339321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:11.339763 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:11.443445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-51b8ecc6-48ea-44a5-8d91-b74a4261cd8d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 20997 microversion: 2.1 time: 0.118871 Jan 28 01:33:11.444112 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 503/1000] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:11 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 20997 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:12.455331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:12.456358 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:12.463846 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:12.464296 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:12.465288 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:12.465563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:12.576177 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-60cd2a8e-9408-42d6-a82a-e6b84984c4c2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 22978 microversion: 2.1 time: 0.124762 Jan 28 01:33:12.576977 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 498/1001] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:12 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 22978 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:33:13.592170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:13.593770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:13.603270 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:13.603747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:13.604576 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:13.605047 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:13.724976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6d025eb2-b046-40dd-bcf6-a279cc3a41b3 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 23927 microversion: 2.1 time: 0.138889 Jan 28 01:33:13.729489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 504/1002] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:13 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 23927 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:14.739878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:14.744599 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:14.748021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:14.748447 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:14.749263 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:14.749698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:14.865485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2be56297-0be7-4898-a454-3636b2dd270e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 25289 microversion: 2.1 time: 0.131104 Jan 28 01:33:14.866545 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 499/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:14 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 25289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:15.879673 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:15.880754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:15.888117 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:15.888581 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:15.889418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:15.889869 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:16.003624 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-a5ac97e9-8e9e-4566-98e5-4a2d82b73230 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 26586 microversion: 2.1 time: 0.128393 Jan 28 01:33:16.004286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 505/1004] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:15 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 26586 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:17.019027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:17.020138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:17.027356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:17.027878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:17.028768 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:17.029371 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:17.146279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9a45fc83-12eb-462e-b6e1-049f84b61153 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 27474 microversion: 2.1 time: 0.131262 Jan 28 01:33:17.147057 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 500/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:17 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 27474 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:18.162521 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:18.164337 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:18.173867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:18.174299 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:18.175439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:18.175888 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:18.322482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2d961c0e-61d3-48b2-8a65-460f6e0df111 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 27896 microversion: 2.1 time: 0.164558 Jan 28 01:33:18.323149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 506/1006] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:18 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 27896 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:19.337312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:19.338353 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:19.345655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:19.346105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:19.346976 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:19.347412 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:19.458849 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a6b69ce1-dfe4-41fe-9227-789fac258180 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28264 microversion: 2.1 time: 0.125181 Jan 28 01:33:19.460425 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 501/1007] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:19 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28264 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:20.473309 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:20.474370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:20.481962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:20.482415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:20.483219 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:20.483658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:20.574720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0ae12d94-ecc8-44d4-9511-1e0f34afd60d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28264 microversion: 2.1 time: 0.105417 Jan 28 01:33:20.575930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 507/1008] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:20 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28264 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:21.591577 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:21.592646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:21.600369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:21.601493 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:21.602310 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:21.602747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:21.729881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e7674fca-fdfc-4e1b-bfba-be665f8e3548 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28296 microversion: 2.1 time: 0.144723 Jan 28 01:33:21.731165 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 502/1009] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:21 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28296 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:22.744598 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:22.745955 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:22.754292 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:22.754774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:22.755574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:22.756009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:22.889388 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-86258620-2269-4147-990a-cccf03f7b553 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28555 microversion: 2.1 time: 0.150411 Jan 28 01:33:22.890200 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 508/1010] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:22 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:23.904496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:23.906317 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:23.913069 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:23.913541 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:23.914340 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:23.914779 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:24.037000 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6aae0d48-ed4d-4a0f-a8a9-8d86f5fd7963 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28722 microversion: 2.1 time: 0.138045 Jan 28 01:33:24.037663 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 503/1011] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:23 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28722 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:25.055329 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:25.057196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:25.066820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:25.067274 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:25.068339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:25.068803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:25.170311 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-69d2065e-1c59-4257-bb01-f1885740d718 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28722 microversion: 2.1 time: 0.123179 Jan 28 01:33:25.171003 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 509/1012] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:25 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28722 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:33:26.184589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:26.185640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:26.192810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:26.193378 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:26.194154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:26.194589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:26.313315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7c20ad82-1b8b-4bf6-a822-a7c4011cb552 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28722 microversion: 2.1 time: 0.132884 Jan 28 01:33:26.314257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 504/1013] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:26 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28722 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:27.330865 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:27.332322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:27.340490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:27.340940 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:27.341782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:27.342195 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:27.444380 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2b8941cf-cf51-424f-954c-f7d03141c888 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 28722 microversion: 2.1 time: 0.119722 Jan 28 01:33:27.447011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 510/1014] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:27 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 28722 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:28.462319 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:28.470188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:28.477783 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:28.478219 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:28.479009 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:28.479433 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:28.602626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-83215217-0605-4c63-b040-b2556d55db32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 29271 microversion: 2.1 time: 0.147844 Jan 28 01:33:28.603333 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 505/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:28 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 29271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:29.617060 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:29.618174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:29.625440 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:29.625882 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:29.626683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:29.627087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:29.733674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f1bd1944-b797-425a-bd5a-9abf7791ebaf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 30765 microversion: 2.1 time: 0.120504 Jan 28 01:33:29.734476 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 511/1016] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:29 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 30765 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:30.746995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:30.748010 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:30.755587 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:30.755953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:30.756768 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:30.757200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:30.869193 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8d477f78-3e8c-44bf-b582-5befd20e7c1c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 32203 microversion: 2.1 time: 0.126103 Jan 28 01:33:30.869870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 506/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:30 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 32203 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:33:31.882827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:31.884169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:31.892052 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:31.892500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:31.893334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:31.893767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:32.006791 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4abd3953-030c-4974-9570-2be4f30e1bb6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 33103 microversion: 2.1 time: 0.128263 Jan 28 01:33:32.007854 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 512/1018] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:31 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 33103 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:33.020636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:33.021654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:33.029698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:33.030151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:33.030954 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:33.031395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:33.134862 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d4a5ce36-02a9-449d-9bec-0554c4db8ff2 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 33607 microversion: 2.1 time: 0.117808 Jan 28 01:33:33.135809 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 507/1019] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:33 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 33607 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:34.151210 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:34.152747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:34.161654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:34.162096 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:34.162900 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:34.163361 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:36.665675 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0e03ccee-d8a3-4e0a-aaad-d4d6c74e533a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 37864 microversion: 2.1 time: 2.520756 Jan 28 01:33:36.666871 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 513/1020] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:34 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 37864 bytes in 2524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:37.678860 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:37.679918 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:37.687302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:37.687743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:37.688527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:37.688968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:37.804022 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d09a6b4c-e314-44b6-a147-27a7d66ccb87 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 38254 microversion: 2.1 time: 0.128814 Jan 28 01:33:37.804987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 508/1021] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:37 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 38254 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:38.819519 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:38.820632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:38.831841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:38.832291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:38.833108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:38.833583 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:38.939013 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-511444d5-9413-4cba-8b7a-3ae1077af557 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 38254 microversion: 2.1 time: 0.125134 Jan 28 01:33:38.939799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 514/1022] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:38 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 38254 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:39.953786 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:39.955094 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:39.962652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:39.963089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:39.963880 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:39.964314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:40.074203 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5165f6fd-b231-44c7-aa2a-5fc2d1786767 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 38254 microversion: 2.1 time: 0.124582 Jan 28 01:33:40.075338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 509/1023] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:39 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 38254 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:41.090317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:41.091327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:41.098476 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:41.098933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:41.099828 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:41.100266 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:41.209162 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bd5cc96c-52ea-4254-a40b-4354cc67589e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 38322 microversion: 2.1 time: 0.123210 Jan 28 01:33:41.210852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 515/1024] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:41 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 38322 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 28 01:33:41.542990 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-285514432", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-423439306", "security_groups": [{"name": "tempest-secgroup-smoke-180707503"}], "block_device_mapping_v2": [{"uuid": "3ee5b9aa-a8ed-4da6-957e-db07f1b67e3b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "73ebb25b-4b41-4be2-af3a-88e69f998b5e"}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:41.673862 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] validate_networks() for [('73ebb25b-4b41-4be2-af3a-88e69f998b5e', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:33:42.222612 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:42.224002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:42.234408 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:42.235098 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:42.236238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:42.236698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:42.352129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d685ae69-839a-4a1b-8666-02fa39b68253 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action" status: 200 len: 38385 microversion: 2.1 time: 0.133661 Jan 28 01:33:42.358065 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 516/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:33:42 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/action => generated 38385 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 28 01:33:42.363769 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:42.364380 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:42.370959 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:33:42.371376 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:33:42.371847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:33:42.372247 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:33:42.372632 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:33:42.373913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:42.374778 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:42.376870 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:42.378006 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:42.382514 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:42.382956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:42.383760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:42.384191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:42.404230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:33:42.410491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d316ee47-e4f2-4707-a962-50e4ca0fcf3a tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/ips" status: 200 len: 146 microversion: 2.1 time: 0.050463 Jan 28 01:33:42.410869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Getting quotas for user 6b11396acc67415abb08ddddf5680df8 and project 12da7c52708b49e8827fb30ea43f8e4d. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:33:42.411453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 517/1026] 10.222.0.16 () {58 vars in 1247 bytes} [Fri Jan 28 01:33:42 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/ips => generated 146 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:42.471021 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:33:42.474677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ee5b9aa-a8ed-4da6-957e-db07f1b67e3b',volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:33:42.620667 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-39a6dca1-6355-49b9-9c13-8167dc9bc579 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.073118 Jan 28 01:33:42.620667 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 510/1027] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:33:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:33:42.642451 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4ae36e3b-24c8-464b-9cb4-0cfe8ca099da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:42.643072 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4ae36e3b-24c8-464b-9cb4-0cfe8ca099da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:42.707344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4ae36e3b-24c8-464b-9cb4-0cfe8ca099da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:42.713942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4ae36e3b-24c8-464b-9cb4-0cfe8ca099da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1093 microversion: 2.1 time: 0.081923 Jan 28 01:33:42.714522 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 518/1028] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:42 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:43.092384 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-899297675", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "2a744785-0656-4be5-87d8-fa5c190efee4"}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:43.146760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] validate_networks() for [('2a744785-0656-4be5-87d8-fa5c190efee4', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:33:43.534877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:33:43.535299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:33:43.535772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:33:43.536170 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:33:43.536576 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:33:43.546816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:43.547261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:43.548068 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:43.548505 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:43.566443 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Getting quotas for project 228f75d4dcc04b3ca2d7e2c443e657d6. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:33:43.570477 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Getting quotas for user ca67647ea67f4812b0c10ea52bbfddbc and project 228f75d4dcc04b3ca2d7e2c443e657d6. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:33:43.582449 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:33:43.584820 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:33:43.631961 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ca06132a-0657-4d30-af17-67e7f4f4e8f7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543212 Jan 28 01:33:43.632949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 511/1029] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:33:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:33:43.642235 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-75717653-75ef-4399-82f6-9dbf1ce10f45 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:43.643020 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-75717653-75ef-4399-82f6-9dbf1ce10f45 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:43.706681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-75717653-75ef-4399-82f6-9dbf1ce10f45 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:43.713487 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-75717653-75ef-4399-82f6-9dbf1ce10f45 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1213 microversion: 2.1 time: 0.074805 Jan 28 01:33:43.715147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 519/1030] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:43 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:43.730879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:43.731578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:43.738675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:43.739127 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:43.739986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:43.740398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:43.759825 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfe2f322-177d-42bd-bcdf-616df9633693"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:43.763872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:43.770781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:43.771268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:43.772266 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:43.773077 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:43.810113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:43.818533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5f56ea97-2e53-4019-b92f-cdb9f86f40bc tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1191 microversion: 2.1 time: 0.091220 Jan 28 01:33:43.819586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 512/1031] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:43 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:44.108132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-654948ff-f208-4277-a0d4-56ac2ba06f61 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.355537 Jan 28 01:33:44.116196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 520/1032] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:33:43 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments => generated 194 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:33:44.732586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:44.733407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:44.742273 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:44.743015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:44.744087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:44.744597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:44.827876 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:44.837508 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f9a1ab24-e1ed-4224-a1fd-ebc554173424 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1265 microversion: 2.1 time: 0.108432 Jan 28 01:33:44.838473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 513/1033] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:44 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:44.838990 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:44.839782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:44.848431 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:44.849287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:44.850710 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:44.851499 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:44.935893 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:44.945184 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ff8bd2f4-a90e-41cc-b6ed-ae4eb62faea4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1209 microversion: 2.1 time: 0.112337 Jan 28 01:33:44.950781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 521/1034] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:44 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:45.858268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:45.859569 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:45.866729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:45.867262 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:45.868036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:45.868468 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:45.967292 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:45.971428 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:45.973562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:45.981496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f58ce778-7635-4317-9444-382b2e4cf839 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1271 microversion: 2.1 time: 0.125455 Jan 28 01:33:45.981990 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 514/1035] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:45 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:33:45.985770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:45.988358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:45.989375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:45.990069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:46.296678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:46.304544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e46c8860-72f8-4971-9536-70300adc27da tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1276 microversion: 2.1 time: 0.340170 Jan 28 01:33:46.305026 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 522/1036] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:45 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1276 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:46.430438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-701a4a0e-0c75-45c9-98ee-fff6bcb3e22b req-320c5c7d-8b9e-49cf-8747-0171c971f7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53", "tag": "416bf0d0-0933-456e-9825-b69e701320a5"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:46.432705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:33:46.432705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:33:46.440128 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-701a4a0e-0c75-45c9-98ee-fff6bcb3e22b req-320c5c7d-8b9e-49cf-8747-0171c971f7d9 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:46.440560 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-701a4a0e-0c75-45c9-98ee-fff6bcb3e22b req-320c5c7d-8b9e-49cf-8747-0171c971f7d9 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:46.454014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-701a4a0e-0c75-45c9-98ee-fff6bcb3e22b req-320c5c7d-8b9e-49cf-8747-0171c971f7d9 service nova] Creating event network-changed:416bf0d0-0933-456e-9825-b69e701320a5 for instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 on hv-cinder-82662 Jan 28 01:33:46.459657 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-701a4a0e-0c75-45c9-98ee-fff6bcb3e22b req-320c5c7d-8b9e-49cf-8747-0171c971f7d9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033260 Jan 28 01:33:46.460852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 515/1037] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:47.000038 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:47.000728 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:47.007920 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:47.008485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:47.009402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:47.009948 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:47.322496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:47.323206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:47.332344 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:47.339180 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:47.339620 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:47.339933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-852410ef-4ab7-4c1f-9d35-93f3278fcb46 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.344361 Jan 28 01:33:47.340424 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:47.340599 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 523/1038] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:46 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:47.340880 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:47.652847 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:47.661086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ad5c5a37-108b-4da0-a4f7-4607eeeed30f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1276 microversion: 2.1 time: 0.343058 Jan 28 01:33:47.661974 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 516/1039] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:47 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:33:48.357777 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:48.358593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:48.364553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:48.365030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:48.365911 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:48.366351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:48.484369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-675c22f1-6cc1-48df-8540-1a20e62c01fa req-e5a18341-c67f-47c5-b45a-bd442db06501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41018449-e667-4d2f-bccc-f2dab5f14c3c", "tag": "31b2871c-58b1-4c17-8c27-c6744c302b75"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:48.486733 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:33:48.486733 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:33:48.496251 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-675c22f1-6cc1-48df-8540-1a20e62c01fa req-e5a18341-c67f-47c5-b45a-bd442db06501 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:48.496784 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-675c22f1-6cc1-48df-8540-1a20e62c01fa req-e5a18341-c67f-47c5-b45a-bd442db06501 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:48.513201 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-675c22f1-6cc1-48df-8540-1a20e62c01fa req-e5a18341-c67f-47c5-b45a-bd442db06501 service nova] Creating event network-changed:31b2871c-58b1-4c17-8c27-c6744c302b75 for instance 41018449-e667-4d2f-bccc-f2dab5f14c3c on hv-cinder-82662 Jan 28 01:33:48.519379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-675c22f1-6cc1-48df-8540-1a20e62c01fa req-e5a18341-c67f-47c5-b45a-bd442db06501 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039540 Jan 28 01:33:48.520279 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 517/1040] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:33:48.635848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:48.644467 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7dde1053-059e-4f17-a0b8-b7fe7e563bb4 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.291221 Jan 28 01:33:48.645069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 524/1041] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:48 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:48.679692 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:48.680416 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:48.689328 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:48.690129 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:48.691457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:48.692207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:48.972404 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:48.981760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-db712998-f891-4a8d-8ada-47494a07fb3f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1276 microversion: 2.1 time: 0.305274 Jan 28 01:33:48.981760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 518/1042] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:48 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1276 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:49.663511 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:49.664500 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:49.671801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:49.672247 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:49.673002 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:49.673465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:49.834326 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:49.843420 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-930b1399-b34f-49e0-b70f-266d866270ac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.184612 Jan 28 01:33:49.843907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 525/1043] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:49 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:50.002225 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:50.003162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:50.010888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:50.011333 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:50.012109 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:50.012527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:50.172686 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:50.181866 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fead189f-6120-4ef5-817f-555f1851d19f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1276 microversion: 2.1 time: 0.185791 Jan 28 01:33:50.182612 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 519/1044] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:49 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:50.860989 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:50.861625 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:50.868134 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:50.868582 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:50.869383 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:50.869814 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.020186 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:51.028829 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1e0654bd-5ceb-48bd-b4b6-5c822e6f6c5b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.171530 Jan 28 01:33:51.029521 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 526/1045] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:50 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:51.204315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:51.205238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:51.215826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:51.217157 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.218842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:51.220147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.369696 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:51.378291 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4e9a5bf4-0910-47f4-8f07-fa08abf83519 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1276 microversion: 2.1 time: 0.180339 Jan 28 01:33:51.378991 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 520/1046] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:51 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1276 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:51.748836 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:51.750113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:51.758269 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:51.758962 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.759745 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:51.760199 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.793497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-00f597cf-2314-41f8-94fe-c47f3b02155b tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049218 Jan 28 01:33:51.793882 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 527/1047] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:33:51 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:51.805975 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:51.806469 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:51.812462 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:51.813006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.813760 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:51.814200 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:51.852222 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d41d6831-b9c7-4c6b-a25f-6986fc48b1e5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/bfe2f322-177d-42bd-bcdf-616df9633693" status: 200 len: 194 microversion: 2.1 time: 0.049764 Jan 28 01:33:51.853473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 521/1048] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jan 28 01:33:51 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/bfe2f322-177d-42bd-bcdf-616df9633693 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:52.050758 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:52.052138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:52.058661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:52.059105 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:52.060342 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:52.060701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:52.274110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:52.282485 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2a62754b-b0d1-48e4-80bb-71d861bda015 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.238461 Jan 28 01:33:52.283417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 528/1049] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:52 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:52.395987 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:52.396726 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:52.404156 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:52.404600 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:52.405427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:52.406411 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:52.569259 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:52.577744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ec361977-a5bb-457d-ad70-c6c55dac181b tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.185925 Jan 28 01:33:52.578327 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 522/1050] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:52 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:53.241255 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e569771-e868-4c88-8606-523056dd8a22"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:53.242652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:53.249516 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.250015 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.250860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.251244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.300491 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:53.301329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:53.308066 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.308506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.309314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.309812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.464489 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:53.472910 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e5503180-8194-4f1c-9a22-b6cdddd47181 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.176508 Jan 28 01:33:53.473590 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 523/1051] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:53 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:53.580600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-65d1661d-c2b3-4ef9-9ee9-4e731bfc999c tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340163 Jan 28 01:33:53.580600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 529/1052] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:33:53 2022] POST /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:53.602637 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:53.603258 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:53.610329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.610781 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.612446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.615211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.673695 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-a4975e6d-f893-4d1a-9ed3-38f2a38ef4cc req-a3a3f044-f5ef-4357-b5cc-c84f706d0ada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41018449-e667-4d2f-bccc-f2dab5f14c3c", "name": "network-vif-plugged", "status": "completed", "tag": "31b2871c-58b1-4c17-8c27-c6744c302b75"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:53.676234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:33:53.676234 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:33:53.684680 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-a4975e6d-f893-4d1a-9ed3-38f2a38ef4cc req-a3a3f044-f5ef-4357-b5cc-c84f706d0ada service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:53.685592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-a4975e6d-f893-4d1a-9ed3-38f2a38ef4cc req-a3a3f044-f5ef-4357-b5cc-c84f706d0ada service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:53.701309 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-a4975e6d-f893-4d1a-9ed3-38f2a38ef4cc req-a3a3f044-f5ef-4357-b5cc-c84f706d0ada service nova] Creating event network-vif-plugged:31b2871c-58b1-4c17-8c27-c6744c302b75 for instance 41018449-e667-4d2f-bccc-f2dab5f14c3c on hv-cinder-82662 Jan 28 01:33:53.706690 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-a4975e6d-f893-4d1a-9ed3-38f2a38ef4cc req-a3a3f044-f5ef-4357-b5cc-c84f706d0ada service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038526 Jan 28 01:33:53.708072 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 530/1053] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:33:53.780537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:53.793192 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9d486db3-3b26-4746-9bfb-4c15da6e41c6 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.195284 Jan 28 01:33:53.793834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 524/1054] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:53 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:33:54.491778 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:54.492476 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:54.499226 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:54.499681 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:54.500497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:54.501069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:54.644631 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:54.653574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-980be162-0dc3-4ec0-b83b-3de6a9d8da90 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1313 microversion: 2.1 time: 0.166229 Jan 28 01:33:54.654144 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 531/1055] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:54 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:54.811088 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:54.811672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:54.821751 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:54.822312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:54.823457 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:54.823998 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:54.964639 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:54.972379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4a7b8bb9-05cf-4e89-aae9-8cb6023ee3d4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.165396 Jan 28 01:33:54.973076 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 525/1056] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:54 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:55.670355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:55.670975 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:55.678642 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:55.679103 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:55.679903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:55.680340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:55.814353 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:55.822817 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5ebb35c4-ed64-466b-94a4-9e6e2b8558ec tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1498 microversion: 2.1 time: 0.156160 Jan 28 01:33:55.823406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 532/1057] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:55 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1498 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:55.990204 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:55.991156 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:55.997893 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:55.998312 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:55.999170 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:55.999596 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:56.153105 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:56.163880 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b6a1482a-d029-4cbd-b58a-21e46555098d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.177428 Jan 28 01:33:56.164484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 526/1058] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:55 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:56.359327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:56.359830 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:56.366784 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:56.367241 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:56.368040 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:56.368482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:56.395933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:33:56.478409 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-adbd5d98-1a5d-4485-9ef4-5512783a64a1 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 204 len: 0 microversion: 2.1 time: 0.122351 Jan 28 01:33:56.479354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 533/1059] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:33:56 2022] DELETE /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:33:56.489276 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:56.491986 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:56.498390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:56.498873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:56.499652 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:56.500086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:56.657676 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:56.666159 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fce2260f-64fa-475a-b908-be534e1dafeb tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1504 microversion: 2.1 time: 0.180651 Jan 28 01:33:56.666774 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 527/1060] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:56 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:33:57.180794 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:57.181597 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:57.188572 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:57.189035 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:57.189907 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:57.190348 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:57.355878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:57.366110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-99313aae-a232-45eb-97e8-3c11441db379 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.189585 Jan 28 01:33:57.366777 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 534/1061] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:57 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:57.687254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:57.688362 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:57.699759 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:57.700210 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:57.701352 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:57.701808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:57.865997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:57.878233 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-614fcfc5-64e3-4526-90b3-8618d29d8f20 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1504 microversion: 2.1 time: 0.196704 Jan 28 01:33:57.878233 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 528/1062] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:57 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:58.383183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:58.383827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:58.391092 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:58.391514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:58.392552 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:58.392754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:58.607812 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:58.616100 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cf0a11e1-a4b2-4b53-961e-4e47dcae30ad tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.236751 Jan 28 01:33:58.616693 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 535/1063] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:58 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:58.900191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:58.902527 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:58.913597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:58.914428 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:58.915336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:58.915829 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:58.944383 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-b28b7aa0-ac1e-4ef6-a163-d500e0bb50cb req-7d70cc0d-4e31-4236-9e56-92c372947b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41018449-e667-4d2f-bccc-f2dab5f14c3c", "name": "network-vif-deleted", "tag": "31b2871c-58b1-4c17-8c27-c6744c302b75"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:33:58.946481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:33:58.946481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:33:58.960647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-b28b7aa0-ac1e-4ef6-a163-d500e0bb50cb req-7d70cc0d-4e31-4236-9e56-92c372947b7c service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:58.961694 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-b28b7aa0-ac1e-4ef6-a163-d500e0bb50cb req-7d70cc0d-4e31-4236-9e56-92c372947b7c service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:58.974082 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-b28b7aa0-ac1e-4ef6-a163-d500e0bb50cb req-7d70cc0d-4e31-4236-9e56-92c372947b7c service nova] Creating event network-vif-deleted:31b2871c-58b1-4c17-8c27-c6744c302b75 for instance 41018449-e667-4d2f-bccc-f2dab5f14c3c on hv-cinder-82662 Jan 28 01:33:58.979597 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-b28b7aa0-ac1e-4ef6-a163-d500e0bb50cb req-7d70cc0d-4e31-4236-9e56-92c372947b7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039172 Jan 28 01:33:58.980771 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 536/1064] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:33:58.990626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:58.998715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-773c2be1-7c99-4404-875b-5fd59d42689c tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 200 len: 1462 microversion: 2.1 time: 0.102268 Jan 28 01:33:58.999304 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 529/1065] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:58 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 1462 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:33:59.635880 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:33:59.636730 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:33:59.644565 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:59.649285 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:59.650401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:33:59.651244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:33:59.811223 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:33:59.819757 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ffb0f8a6-fdb3-4ef8-9df2-1497e9664f7d tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.188678 Jan 28 01:33:59.820351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 537/1066] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:33:59 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:00.018108 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:00.019048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: 41018449-e667-4d2f-bccc-f2dab5f14c3c] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:00.036381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:00.036381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:00.038070 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:00.039167 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:00.056859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] HTTP exception thrown: Instance 41018449-e667-4d2f-bccc-f2dab5f14c3c could not be found. Jan 28 01:34:00.057580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Returning 404 to user: Instance 41018449-e667-4d2f-bccc-f2dab5f14c3c could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:00.058557 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-72101a61-a44a-40e0-89a4-f3acbef9a9d7 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c" status: 404 len: 111 microversion: 2.1 time: 0.045723 Jan 28 01:34:00.059306 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 530/1067] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:00 2022] GET /compute/v2.1/servers/41018449-e667-4d2f-bccc-f2dab5f14c3c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:00.114621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2076821752", "imageRef": "1e03ff6e-f674-47de-903a-0e5bf6218657", "flavorRef": "452", "networks": [{"uuid": "2a744785-0656-4be5-87d8-fa5c190efee4"}]}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:00.174774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.network.neutron [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] validate_networks() for [('2a744785-0656-4be5-87d8-fa5c190efee4', None, None, None, None, None)] {{(pid=116162) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:34:00.574861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Flavor limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:34:00.575293 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Image limits 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:34:00.575774 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Flavor pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:34:00.576213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Image pref 0:0:0 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:34:00.576600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.virt.hardware [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116162) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:34:00.586958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:00.587403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:00.588207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:00.588636 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:00.607157 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Getting quotas for project 228f75d4dcc04b3ca2d7e2c443e657d6. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:34:00.611354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Getting quotas for user ca67647ea67f4812b0c10ea52bbfddbc and project 228f75d4dcc04b3ca2d7e2c443e657d6. Resources: {'instances', 'ram', 'cores'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:34:00.625722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Going to run 1 instances... {{(pid=116162) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:34:00.628368 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1e03ff6e-f674-47de-903a-0e5bf6218657',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116162) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:34:00.678939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f788fd93-f629-44ec-bb47-949ebaa9edac tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571471 Jan 28 01:34:00.681375 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 538/1068] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:34:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:34:00.689323 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-484c784b-52fe-42d4-a000-6b539fa8e563 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:00.690204 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-484c784b-52fe-42d4-a000-6b539fa8e563 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:00.747771 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-484c784b-52fe-42d4-a000-6b539fa8e563 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:00.760563 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-484c784b-52fe-42d4-a000-6b539fa8e563 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1214 microversion: 2.1 time: 0.074824 Jan 28 01:34:00.762964 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 531/1069] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:00 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:00.844406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:00.845436 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:00.858537 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:00.859259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:00.860514 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:00.861421 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.025817 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:01.033621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cab3e24a-a8cb-429d-a5fc-86258c4536a3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.195643 Jan 28 01:34:01.034204 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 539/1070] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:00 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:01.350178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:01.351139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:01.357924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.358365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.359149 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.359571 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.390191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1e015168-9bd3-4f0c-a4a5-67c1628d11ca tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.233421 Jan 28 01:34:01.390780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 532/1071] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:34:01 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments => generated 371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:01.667799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-ea051ae7-a0c9-4f4e-b4b4-cb836d86abe4 req-7429d097-c91d-4a3e-b6f3-3b91d21dc485 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53", "name": "network-vif-plugged", "status": "completed", "tag": "416bf0d0-0933-456e-9825-b69e701320a5"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:01.673826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:34:01.673826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:34:01.677714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ea051ae7-a0c9-4f4e-b4b4-cb836d86abe4 req-7429d097-c91d-4a3e-b6f3-3b91d21dc485 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.678283 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ea051ae7-a0c9-4f4e-b4b4-cb836d86abe4 req-7429d097-c91d-4a3e-b6f3-3b91d21dc485 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.683236 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:01.683608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:01.691220 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-ea051ae7-a0c9-4f4e-b4b4-cb836d86abe4 req-7429d097-c91d-4a3e-b6f3-3b91d21dc485 service nova] Creating event network-vif-plugged:416bf0d0-0933-456e-9825-b69e701320a5 for instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 on hv-cinder-82662 Jan 28 01:34:01.691991 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.691991 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.692907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.693634 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.696350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-ea051ae7-a0c9-4f4e-b4b4-cb836d86abe4 req-7429d097-c91d-4a3e-b6f3-3b91d21dc485 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033310 Jan 28 01:34:01.697358 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 540/1072] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:01.741113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-46cfd50f-fbd9-4071-b928-261cefada9c6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/bfe2f322-177d-42bd-bcdf-616df9633693" status: 200 len: 194 microversion: 2.1 time: 0.061941 Jan 28 01:34:01.741670 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 533/1073] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jan 28 01:34:01 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/bfe2f322-177d-42bd-bcdf-616df9633693 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:34:01.754575 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:01.755169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:01.761639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.762078 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.762857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.763866 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.779438 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:01.780090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:01.786302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.786831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.787885 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:01.788616 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:01.860228 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:01.865942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lazy-loading 'services' on Instance uuid 5475dd5f-267e-4bff-b143-07ec67f2acf2 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:34:01.871791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-79fe0390-0aee-4450-b873-65aee66200e9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1266 microversion: 2.1 time: 0.096139 Jan 28 01:34:01.872534 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 534/1074] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:01 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1266 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:01.944286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3635bee3-b441-4aef-ac60-2e0c5d8385f4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/bfe2f322-177d-42bd-bcdf-616df9633693" status: 202 len: 0 microversion: 2.1 time: 0.195502 Jan 28 01:34:01.945159 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 541/1075] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:34:01 2022] DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/bfe2f322-177d-42bd-bcdf-616df9633693 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:34:02.055220 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:02.056440 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:02.065080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:02.065729 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:02.067169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:02.067896 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:02.351536 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:02.361648 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-091d911e-40a9-495b-b9bb-e9c2f8b83907 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.312161 Jan 28 01:34:02.362269 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 535/1076] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:02 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:34:02.891011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:02.891011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:02.891011 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:02.899496 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:02.899653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:02.900253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:03.187464 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:03.195217 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c9c75269-b5e5-4a78-b711-41874358f56d tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.308714 Jan 28 01:34:03.205427 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 542/1077] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:02 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:34:03.385016 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:03.385869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:03.393666 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:03.394119 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:03.394937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:03.395369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:03.662859 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:03.678286 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fcc00c5b-2c23-4afa-9627-19a761e82600 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1264 microversion: 2.1 time: 0.300114 Jan 28 01:34:03.679298 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 536/1078] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:03 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1264 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:03.813574 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-3c44115b-af56-4e82-b6af-ca0e9c235315 req-8748b15d-8bee-479e-9b6d-86082a26dba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f", "tag": "03fccd1b-f9a8-4e30-b407-4591d97fab8b"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:03.818272 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:34:03.818272 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:34:03.832493 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-3c44115b-af56-4e82-b6af-ca0e9c235315 req-8748b15d-8bee-479e-9b6d-86082a26dba7 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:03.833847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-3c44115b-af56-4e82-b6af-ca0e9c235315 req-8748b15d-8bee-479e-9b6d-86082a26dba7 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:03.855658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-3c44115b-af56-4e82-b6af-ca0e9c235315 req-8748b15d-8bee-479e-9b6d-86082a26dba7 service nova] Creating event network-changed:03fccd1b-f9a8-4e30-b407-4591d97fab8b for instance bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f on hv-cinder-82662 Jan 28 01:34:03.863526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-3c44115b-af56-4e82-b6af-ca0e9c235315 req-8748b15d-8bee-479e-9b6d-86082a26dba7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058280 Jan 28 01:34:03.864980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 543/1079] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:04.199598 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:04.200099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:04.212949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.213778 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.214614 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.215056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.217873 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:04.218815 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:04.227488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.227488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.227488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.227488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.252130 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bca018b3-4f4d-43c8-bc96-94047c4b37a5 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/0e569771-e868-4c88-8606-523056dd8a22" status: 200 len: 194 microversion: 2.1 time: 0.056788 Jan 28 01:34:04.252938 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 537/1080] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Jan 28 01:34:04 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/0e569771-e868-4c88-8606-523056dd8a22 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:04.263082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:04.263587 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:04.270063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.270489 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.271388 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.271771 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.356721 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lazy-loading 'services' on Instance uuid 5475dd5f-267e-4bff-b143-07ec67f2acf2 {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:34:04.425790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:04.435411 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-37e71e60-865b-4694-b5ae-6f7ecf5a829f tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.222373 Jan 28 01:34:04.436481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 544/1081] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:04 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:34:04.446212 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7b7b1872-c270-4cf4-9f21-edcfb2823f32 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/0e569771-e868-4c88-8606-523056dd8a22" status: 202 len: 0 microversion: 2.1 time: 0.186296 Jan 28 01:34:04.447418 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 538/1082] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:34:04 2022] DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments/0e569771-e868-4c88-8606-523056dd8a22 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:34:04.705036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:04.706167 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:04.716950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.717532 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.718356 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:04.719081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:04.975315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:04.985466 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-196dbf9d-10d5-4d5a-a3c6-1551a6710477 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1450 microversion: 2.1 time: 0.285809 Jan 28 01:34:04.986028 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 545/1083] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:04 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1450 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:34:05.002475 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:05.003185 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:05.012868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:05.012868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:05.012868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:05.012868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:05.458319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:05.458824 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:05.468971 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:05.469839 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:05.471275 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:05.472303 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:05.570562 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:05.602023 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-03dd722a-8062-4f52-944a-0b72625db62e tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1450 microversion: 2.1 time: 0.603228 Jan 28 01:34:05.602941 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 539/1084] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:04 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1450 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:05.730622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:05.738141 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0cd464c5-36bf-4cdf-9b93-3ef3340496e5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.287009 Jan 28 01:34:05.738719 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 546/1085] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:05 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:34:06.711316 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:06.712405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:06.719422 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.719882 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.720680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.721119 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.753790 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bd8cac97-b94b-4226-ac7d-a5c230578cf9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046308 Jan 28 01:34:06.757415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 540/1086] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:34:06 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:34:06.757605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:06.757605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:06.764090 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.764512 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.765327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.765762 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.866908 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:06.867827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:06.874181 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.874620 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.875435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.875931 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.905900 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-94bb9164-d581-43c6-96bd-7239508818e6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042822 Jan 28 01:34:06.906570 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 541/1087] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:34:06 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 28 01:34:06.933647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:06.942661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-26619440-5777-4882-b80a-5cc8ff09cc91 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.189857 Jan 28 01:34:06.945294 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 547/1088] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:06 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:06.976288 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:06.976864 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:06.984087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.984087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:06.985012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:06.985421 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:07.015607 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:34:07.103949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-621c83bb-a536-444f-b678-c68d38f9b9a8 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 204 len: 0 microversion: 2.1 time: 0.131336 Jan 28 01:34:07.104884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 542/1089] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:34:06 2022] DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:34:07.114734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:07.115196 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:07.122686 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:07.123145 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:07.123958 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:07.124399 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:07.293856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:07.302042 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-876c4f61-dd13-47cc-a42f-8591fa05e28f tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1674 microversion: 2.1 time: 0.191420 Jan 28 01:34:07.302682 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 548/1090] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:07 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:07.558095 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-88f4c044-07fc-4abf-a21d-e584508aea5e req-04d75faf-7b63-44f9-b238-e28735e71425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53", "tag": "416bf0d0-0933-456e-9825-b69e701320a5"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:07.560888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:34:07.560888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:34:07.579064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-88f4c044-07fc-4abf-a21d-e584508aea5e req-04d75faf-7b63-44f9-b238-e28735e71425 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:07.580151 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-88f4c044-07fc-4abf-a21d-e584508aea5e req-04d75faf-7b63-44f9-b238-e28735e71425 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:07.603217 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-88f4c044-07fc-4abf-a21d-e584508aea5e req-04d75faf-7b63-44f9-b238-e28735e71425 service nova] Creating event network-changed:416bf0d0-0933-456e-9825-b69e701320a5 for instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 on hv-cinder-82662 Jan 28 01:34:07.612981 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-88f4c044-07fc-4abf-a21d-e584508aea5e req-04d75faf-7b63-44f9-b238-e28735e71425 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064961 Jan 28 01:34:07.614937 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 543/1091] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:07.966037 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:07.967088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:07.974260 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:07.974863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:07.975879 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:07.976393 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:08.230067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:08.251827 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-3e14d4c8-6ddd-4c43-9451-031c4edc9bd9 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.289569 Jan 28 01:34:08.253925 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 549/1092] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:07 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:34:08.321804 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:08.323602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:08.339715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:08.340207 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:08.341217 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:08.342066 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:08.531046 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:08.545745 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bb1b93d0-0843-4841-8507-0f49224502bf tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1674 microversion: 2.1 time: 0.228987 Jan 28 01:34:08.546352 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 544/1093] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:08 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:09.270767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:09.271602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:09.278491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:09.278950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:09.279745 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:09.280181 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:09.434482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:09.441792 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-29177f3c-2887-45e5-aea6-51e69c666e76 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.174800 Jan 28 01:34:09.445123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 550/1094] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:09 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:09.564614 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:09.565572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:09.577154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:09.578062 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:09.579569 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:09.580641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:09.715387 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-ad95c37b-1821-47c1-a37b-19961a7da048 req-afb62083-729d-4d7c-b1ac-54726ec32fee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f", "name": "network-vif-plugged", "status": "completed", "tag": "03fccd1b-f9a8-4e30-b407-4591d97fab8b"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:09.717846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:34:09.717846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:34:09.738059 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ad95c37b-1821-47c1-a37b-19961a7da048 req-afb62083-729d-4d7c-b1ac-54726ec32fee service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:09.738949 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ad95c37b-1821-47c1-a37b-19961a7da048 req-afb62083-729d-4d7c-b1ac-54726ec32fee service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:09.753869 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-ad95c37b-1821-47c1-a37b-19961a7da048 req-afb62083-729d-4d7c-b1ac-54726ec32fee service nova] Creating event network-vif-plugged:03fccd1b-f9a8-4e30-b407-4591d97fab8b for instance bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f on hv-cinder-82662 Jan 28 01:34:09.760544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-ad95c37b-1821-47c1-a37b-19961a7da048 req-afb62083-729d-4d7c-b1ac-54726ec32fee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048850 Jan 28 01:34:09.762365 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 551/1095] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:34:09.789990 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:09.803902 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ea818d40-98eb-4ca0-b9f1-98a2f8d35d0e tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1674 microversion: 2.1 time: 0.243053 Jan 28 01:34:09.805031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 545/1096] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:09 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1674 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:10.460662 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:10.463017 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:10.470820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:10.471376 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:10.472276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:10.472819 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:10.764213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:10.772568 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-66d2960e-3a29-40de-8e39-bbb851e9058b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1314 microversion: 2.1 time: 0.316380 Jan 28 01:34:10.773373 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 552/1097] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:10 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:10.821890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:10.822755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:10.829887 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:10.830424 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:10.831302 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:10.831741 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:11.160357 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:11.169701 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9dde5dd3-1eba-437b-b5c7-69904cb8ade4 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1674 microversion: 2.1 time: 0.351874 Jan 28 01:34:11.170318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 546/1098] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:10 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1674 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:11.399593 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-566e19ab-1975-44b5-bacc-0a9817c0258a req-924467a1-6ce9-4876-bc8e-4963e744ed76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5475dd5f-267e-4bff-b143-07ec67f2acf2", "name": "network-vif-deleted", "tag": "14540d13-5f10-4707-bda7-17d4c9430211"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:11.402352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:34:11.402352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:34:11.410732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-566e19ab-1975-44b5-bacc-0a9817c0258a req-924467a1-6ce9-4876-bc8e-4963e744ed76 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:11.411589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-566e19ab-1975-44b5-bacc-0a9817c0258a req-924467a1-6ce9-4876-bc8e-4963e744ed76 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:11.433767 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-566e19ab-1975-44b5-bacc-0a9817c0258a req-924467a1-6ce9-4876-bc8e-4963e744ed76 service nova] Creating event network-vif-deleted:14540d13-5f10-4707-bda7-17d4c9430211 for instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 on hv-cinder-82662 Jan 28 01:34:11.440110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-566e19ab-1975-44b5-bacc-0a9817c0258a req-924467a1-6ce9-4876-bc8e-4963e744ed76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044757 Jan 28 01:34:11.440784 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 553/1099] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:34:11.790419 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:11.791086 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:11.798088 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:11.798538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:11.799382 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:11.799819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:11.971730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:11.981326 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-572d24e3-5925-4647-a83f-a4d1fd41782b tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1499 microversion: 2.1 time: 0.194983 Jan 28 01:34:11.982320 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 547/1100] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:11 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1499 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:12.189584 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:12.190601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:12.197669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.198287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.199809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.200704 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.242976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.243317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.243934 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lazy-loading 'fault' on Instance uuid 5475dd5f-267e-4bff-b143-07ec67f2acf2 {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:34:12.313561 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f02cd9096152479da885ead20d3ec061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0639b703e727474d8b71d24f7709a813', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:12.321034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6016ac68-d910-4c67-a10e-d54a2fcaefef tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 200 len: 1328 microversion: 2.1 time: 0.136415 Jan 28 01:34:12.322168 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 554/1101] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:12 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 1328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:12.656249 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:12.656748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:12.663145 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.663654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.664453 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.664881 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.695606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:34:12.777906 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-be92f7ec-6ddd-4521-83ac-ebceb0daf390 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 204 len: 0 microversion: 2.1 time: 0.125016 Jan 28 01:34:12.778528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 548/1102] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:34:12 2022] DELETE /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:34:12.787462 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:12.788106 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:12.794679 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.795238 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.796040 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:12.796505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:12.936218 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:12.945782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-237c095f-7aa1-40ec-a6b1-c54d6f758ef5 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1505 microversion: 2.1 time: 0.162094 Jan 28 01:34:12.946350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 555/1103] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:12 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:13.347399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:13.348027 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:13.354772 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:13.355211 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:13.355995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:13.356423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:13.372289 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] HTTP exception thrown: Instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 could not be found. Jan 28 01:34:13.372997 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Returning 404 to user: Instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:13.373926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ef45fd18-ab7e-4bfa-8574-cf61f59ab9d9 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 404 len: 111 microversion: 2.1 time: 0.031556 Jan 28 01:34:13.374565 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 549/1104] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:13 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:13.384863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5581a34e-6e42-4f10-9ad1-61032b2b5e88 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '.version_select at 0x7f7e76dc4e50>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:13.408253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5581a34e-6e42-4f10-9ad1-61032b2b5e88 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768346326" status: 202 len: 0 microversion: 2.1 time: 0.027929 Jan 28 01:34:13.408834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 556/1105] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Jan 28 01:34:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1768346326 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:34:13.963524 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:13.964423 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:13.973531 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:13.974884 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:13.977084 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:13.977510 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:14.135326 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:14.148680 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d01f7d33-c58f-488e-a15b-79d73e4f7b61 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1505 microversion: 2.1 time: 0.188422 Jan 28 01:34:14.149905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 550/1106] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:13 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:14.990323 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-17e4567b-25fc-481d-8d61-3f16c882976f req-af0e50c0-eaf6-43ab-8453-f7fd1e991a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f", "name": "network-vif-deleted", "tag": "03fccd1b-f9a8-4e30-b407-4591d97fab8b"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:34:14.991851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:34:14.991851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:34:15.001637 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-17e4567b-25fc-481d-8d61-3f16c882976f req-af0e50c0-eaf6-43ab-8453-f7fd1e991a27 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:15.002081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-17e4567b-25fc-481d-8d61-3f16c882976f req-af0e50c0-eaf6-43ab-8453-f7fd1e991a27 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:15.014562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-17e4567b-25fc-481d-8d61-3f16c882976f req-af0e50c0-eaf6-43ab-8453-f7fd1e991a27 service nova] Creating event network-vif-deleted:03fccd1b-f9a8-4e30-b407-4591d97fab8b for instance bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f on hv-cinder-82662 Jan 28 01:34:15.019586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-17e4567b-25fc-481d-8d61-3f16c882976f req-af0e50c0-eaf6-43ab-8453-f7fd1e991a27 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033650 Jan 28 01:34:15.020436 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 557/1107] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:15.177654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:15.178331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:15.187039 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:15.187583 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:15.188684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:15.189190 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:15.225416 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:15.225851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:15.226561 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lazy-loading 'fault' on Instance uuid bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:34:15.274072 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca67647ea67f4812b0c10ea52bbfddbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228f75d4dcc04b3ca2d7e2c443e657d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:34:15.281516 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6d1b623f-9646-4cc2-9949-940ddfec0197 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 200 len: 1304 microversion: 2.1 time: 0.108865 Jan 28 01:34:15.282079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 551/1108] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:15 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:16.302013 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:16.302828 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] [instance: bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:16.313297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:16.313297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:16.314265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:16.314913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:16.330099 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] HTTP exception thrown: Instance bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f could not be found. Jan 28 01:34:16.330694 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] Returning 404 to user: Instance bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:16.331519 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-54dd46db-ec53-46e3-b8e3-4c597ed85013 tempest-VolumesActionsTest-930800598 tempest-VolumesActionsTest-930800598-project] 10.222.0.16 "GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f" status: 404 len: 111 microversion: 2.1 time: 0.034157 Jan 28 01:34:16.332062 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 558/1109] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:16 2022] GET /compute/v2.1/servers/bc0ec9a7-f95d-4cb7-8dac-53c557f19b7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:16.395750 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:16.397889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:16.407924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:16.408728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:16.409907 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:16.410589 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:16.425631 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] HTTP exception thrown: Instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 could not be found. Jan 28 01:34:16.426213 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Returning 404 to user: Instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:16.427081 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-cee3040c-0b1d-4c70-b512-06fa88ca5bd0 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 404 len: 111 microversion: 2.1 time: 0.037800 Jan 28 01:34:16.427586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 552/1110] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:34:16 2022] DELETE /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:16.435646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:16.436321 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 5475dd5f-267e-4bff-b143-07ec67f2acf2] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:16.443157 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:16.443611 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:16.444545 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:16.444991 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:16.459595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] HTTP exception thrown: Instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 could not be found. Jan 28 01:34:16.460222 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Returning 404 to user: Instance 5475dd5f-267e-4bff-b143-07ec67f2acf2 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:16.461019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5d96caf2-960d-4a13-9055-2626b242062d tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2" status: 404 len: 111 microversion: 2.1 time: 0.029263 Jan 28 01:34:16.461601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 559/1111] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:16 2022] GET /compute/v2.1/servers/5475dd5f-267e-4bff-b143-07ec67f2acf2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:17.611715 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:17.612284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:17.619572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:17.619994 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:17.621011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:17.621487 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:17.636283 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] HTTP exception thrown: Instance 66b5cb18-2b39-4a8d-9832-43a930270995 could not be found. Jan 28 01:34:17.636891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Returning 404 to user: Instance 66b5cb18-2b39-4a8d-9832-43a930270995 could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:17.637858 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1ef6a520-4edc-4b49-969d-43afd84b7f15 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "DELETE /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 404 len: 111 microversion: 2.1 time: 0.032326 Jan 28 01:34:17.638415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 553/1112] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:34:17 2022] DELETE /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:34:17.647037 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:17.647676 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] [instance: 66b5cb18-2b39-4a8d-9832-43a930270995] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:34:17.654787 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:17.655254 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:17.656079 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:34:17.656530 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:34:17.670650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] HTTP exception thrown: Instance 66b5cb18-2b39-4a8d-9832-43a930270995 could not be found. Jan 28 01:34:17.671237 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] Returning 404 to user: Instance 66b5cb18-2b39-4a8d-9832-43a930270995 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:34:17.672056 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-90ef50f3-f026-411c-98e2-150e7524f6a6 tempest-AttachVolumeTestJSON-972141326 tempest-AttachVolumeTestJSON-972141326-project] 10.222.0.16 "GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995" status: 404 len: 111 microversion: 2.1 time: 0.029058 Jan 28 01:34:17.672773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 560/1113] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:34:17 2022] GET /compute/v2.1/servers/66b5cb18-2b39-4a8d-9832-43a930270995 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 28 01:34:24.415730 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-49351281-7b16-4c8e-a480-ce26c848ef9b tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7fab54c0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:24.486012 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-49351281-7b16-4c8e-a480-ce26c848ef9b tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe34e3c1-d1c4-4c46-a8fe-f7dd5181c011" status: 200 len: 350 microversion: 2.1 time: 0.073804 Jan 28 01:34:24.493026 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 554/1114] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:34:24 2022] GET /compute/v2.1/os-volumes/fe34e3c1-d1c4-4c46-a8fe-f7dd5181c011 => generated 350 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:34:26.049980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c3899ecb-fd65-4985-a023-79ed2afe576a tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7766f550>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:26.120314 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c3899ecb-fd65-4985-a023-79ed2afe576a tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b094e939-f1b4-4c17-b55e-df4b95148513" status: 200 len: 351 microversion: 2.1 time: 0.078387 Jan 28 01:34:26.121950 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 561/1115] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:34:26 2022] GET /compute/v2.1/os-volumes/b094e939-f1b4-4c17-b55e-df4b95148513 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:27.626813 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e0c11094-66ce-4460-8d64-3d40d9822741 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7faab820>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:27.684317 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e0c11094-66ce-4460-8d64-3d40d9822741 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/6b8852ca-794f-4cc9-a320-4feb734e3efc" status: 200 len: 351 microversion: 2.1 time: 0.061726 Jan 28 01:34:27.685165 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 555/1116] 10.222.0.16 () {58 vars in 1244 bytes} [Fri Jan 28 01:34:27 2022] GET /compute/v2.1/os-volumes/6b8852ca-794f-4cc9-a320-4feb734e3efc => generated 351 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:27.698994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0c894b64-9a06-4ab0-bf6e-43ce8b60a479 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e76dc4670>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:27.789415 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0c894b64-9a06-4ab0-bf6e-43ce8b60a479 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094722 Jan 28 01:34:27.790505 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 562/1117] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jan 28 01:34:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:27.806139 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6db2920d-2955-42e2-873c-b8126858f3e1 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7f929f70>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:27.946838 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6db2920d-2955-42e2-873c-b8126858f3e1 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.145738 Jan 28 01:34:27.947728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 556/1118] 10.222.0.16 () {58 vars in 1148 bytes} [Fri Jan 28 01:34:27 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:34:27.969349 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-90c81e96-07ec-4c7f-8a02-ad13b563c298 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e76de9550>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:28.099009 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-90c81e96-07ec-4c7f-8a02-ad13b563c298 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.137590 Jan 28 01:34:28.100124 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 563/1119] 10.222.0.16 () {58 vars in 1133 bytes} [Fri Jan 28 01:34:27 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:28.115978 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-faa3380a-b570-44e4-b99f-7c8f40694a6f tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7fac53a0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:28.225538 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-faa3380a-b570-44e4-b99f-7c8f40694a6f tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.115507 Jan 28 01:34:28.226784 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 557/1120] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Jan 28 01:34:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:28.240793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1cb37111-2668-46f7-8d59-e34726ff64d3 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e77652af0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:28.336465 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1cb37111-2668-46f7-8d59-e34726ff64d3 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.100726 Jan 28 01:34:28.337352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 564/1121] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Jan 28 01:34:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:28.353842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-01026394-c36f-4ab9-9d5c-bcada574903f tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7faab670>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:28.492501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-01026394-c36f-4ab9-9d5c-bcada574903f tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.142793 Jan 28 01:34:28.493287 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 558/1122] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Jan 28 01:34:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:34:28.512046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-524a2fe8-4eb2-4f98-aa1c-8a3b55692ece tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e76dc4430>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:28.636340 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-524a2fe8-4eb2-4f98-aa1c-8a3b55692ece tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.129700 Jan 28 01:34:28.637759 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 565/1123] 10.222.0.16 () {58 vars in 1187 bytes} [Fri Jan 28 01:34:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:34:28.649774 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2ed2409d-ea45-4dc0-96ac-a2c7edbcd1f1 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] Calling method '.version_select at 0x7f7e7fa68700>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:34:28.756824 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2ed2409d-ea45-4dc0-96ac-a2c7edbcd1f1 tempest-VolumesTestJSON-1283701610 tempest-VolumesTestJSON-1283701610-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.111169 Jan 28 01:34:28.757812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 559/1124] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Jan 28 01:34:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:06.641797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:35:06.642525 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: Fri Jan 28 01:35:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:35:11.048207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:11.048933 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:11.056052 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:11.056639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:11.057491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:11.057938 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:11.082669 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lazy-loading 'flavor' on Instance uuid 81e28f7e-f8f3-4b0a-a707-793d663d1a9e {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:35:11.159785 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d21991f1-70c2-4451-836c-58e0037385cc tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "POST /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e/action" status: 202 len: 0 microversion: 2.1 time: 0.115989 Jan 28 01:35:11.160383 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 566/1125] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:35:11 2022] POST /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:35:11.169734 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:11.170314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:11.177566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:11.178011 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:11.178797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:11.179236 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:11.482776 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:11.491030 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3052e0ff-00f3-49b6-b0a1-c1725b3c2dae tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.325878 Jan 28 01:35:11.491611 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 560/1126] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:11 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:12.510477 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:12.511142 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:12.517908 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:12.518360 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:12.519150 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:12.519585 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:12.720734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:12.728437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2edd4ca2-db2e-4230-ba3e-a18ebe61e3e5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.222519 Jan 28 01:35:12.729026 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 567/1127] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:12 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:13.749747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:13.751431 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:13.760976 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:13.761456 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:13.762271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:13.762698 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:13.920677 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:13.929539 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-b909f45d-40ce-4ee5-8fe3-fdb13e13f215 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.185025 Jan 28 01:35:13.937528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 561/1128] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:13 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:14.948616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:14.949402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:14.957088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:14.957687 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:14.958647 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:14.959185 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:15.111371 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:15.119538 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-25a1a948-ec50-4a09-8442-7773fc9f8be8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.175763 Jan 28 01:35:15.120123 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 568/1129] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:14 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:16.138552 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:16.139260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:16.146132 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:16.146572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:16.147351 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:16.147782 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:16.291905 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:16.303045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-618c03a3-f0a4-42f8-ac3f-42deb7b6ca20 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.167877 Jan 28 01:35:16.303672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 562/1130] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:16 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:17.320560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:17.321612 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:17.331548 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:17.332010 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:17.332853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:17.333322 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:17.481601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:17.490481 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-c5fe9b44-a564-4a3a-a12c-4a42e9d14c02 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.173912 Jan 28 01:35:17.491253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 569/1131] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:17 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:18.509892 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:18.511256 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:18.529543 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:18.530463 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:18.532074 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:18.532731 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:18.728181 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:18.736145 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-121ad4eb-33a9-4687-b1b2-25c4826cdd7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.230917 Jan 28 01:35:18.745673 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 563/1132] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:18 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:19.753851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:19.754470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:19.760936 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:19.761645 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:19.762491 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:19.762922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:19.908116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:19.916256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-96425e8f-8138-49a4-bbb0-af8fac372546 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.166621 Jan 28 01:35:19.916875 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 570/1133] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:19 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:20.940407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:20.941850 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:20.950238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:20.950683 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:20.951717 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:20.952159 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:21.225441 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:21.234518 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-f3d8f8b5-1dc2-4b4a-a56a-f8a3e64c138d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.298382 Jan 28 01:35:21.235365 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 564/1134] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:20 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:22.259362 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:22.259994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:22.274667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:22.275279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:22.275941 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:22.276370 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:22.451501 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:22.459885 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7af37f85-85a6-48bf-a74a-ecd6a8646dd7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.204426 Jan 28 01:35:22.460818 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 571/1135] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:22 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:23.477486 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:23.478080 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:23.484334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:23.484775 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:23.485578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:23.486024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:23.723432 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:23.743710 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4d7070a6-bcfd-487a-8003-87c6b0f31d78 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.267983 Jan 28 01:35:23.744748 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 565/1136] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:23 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:24.763057 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:24.763877 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:24.772265 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:24.773201 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:24.774053 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:24.774712 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:25.261490 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:25.269338 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-16218edb-aa86-4232-83ec-6f53416f7feb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.511365 Jan 28 01:35:25.273276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 572/1137] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:24 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:26.287240 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:26.288007 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:26.296079 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:26.297602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:26.302071 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:26.302711 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:26.764810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:26.775714 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2b445418-8923-492e-bfb4-629086c1373e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.492392 Jan 28 01:35:26.776999 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 566/1138] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:26 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:27.802190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:27.802190 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:27.810526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:27.810526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:27.810526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:27.810526 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:28.106377 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:28.119887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-81efd9eb-a7c4-4305-bcf5-6859346f4bc2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.327503 Jan 28 01:35:28.121600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 573/1139] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:27 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:29.142297 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:29.142955 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:29.153345 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:29.153792 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:29.156573 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:29.157024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:29.456719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:29.471360 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-775553cf-40f6-4f8d-8386-f8df47736f8d tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.335571 Jan 28 01:35:29.472049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 567/1140] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:29 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:30.489770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:30.490355 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:30.496536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:30.497055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:30.497921 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:30.498414 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:30.679159 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:30.687523 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-f2c5cab8-c72a-4728-a29e-97a7b745f8bb tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.202044 Jan 28 01:35:30.694597 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 574/1141] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:30 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:31.705393 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:31.706094 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:31.713432 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:31.714399 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:31.715454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:31.716102 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:31.990608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:32.005926 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d4c18d7b-df30-4961-a434-9866d5ac3b7c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.305236 Jan 28 01:35:32.009965 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 568/1142] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:31 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:33.025108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:33.025775 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:33.032699 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:33.033557 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:33.034587 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:33.035247 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:33.201768 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:33.209891 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-07e3b272-8eb5-4815-877c-709fb1d9f78a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.188570 Jan 28 01:35:33.211132 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 575/1143] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:33 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:34.228114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:34.229566 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:34.246891 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:34.248460 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:34.249374 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:34.253336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:34.445051 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:34.459605 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-53807dd6-7993-4b0c-8550-e8631dae420c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.235934 Jan 28 01:35:34.460816 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 569/1144] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:34 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:35.481117 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:35.483171 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:35.496268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:35.497498 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:35.499431 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:35.500447 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:35.742754 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:35.761001 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-378d5709-fe6c-4614-a3a9-7d10a5b51185 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.283843 Jan 28 01:35:35.765632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 576/1145] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:35 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:36.779099 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:36.779648 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:36.787471 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:36.788183 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:36.789116 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:36.789769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:36.951014 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:36.961633 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-930dff39-a35c-4ec9-9b44-99f5c1b4a03a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.186714 Jan 28 01:35:36.965852 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 570/1146] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:36 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:37.979652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:37.980397 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:37.987195 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:37.987643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:37.988443 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:37.988905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:38.145110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:38.161401 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9a32cd4a-1db3-44f3-abff-07a4a1d99f1f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.185883 Jan 28 01:35:38.172947 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 577/1147] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:37 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:39.181015 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:39.182449 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:39.189981 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:39.190436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:39.191405 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:39.192083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:39.450567 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:39.460740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7d0931ea-fecc-45ff-b831-7f90e3aa60ed tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.283895 Jan 28 01:35:39.462036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 571/1148] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:39 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:39.959096 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-d22fa0ef-a884-4475-b292-6f4666e2087c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Action: 'create', calling method: .version_select at 0x7f7e76de9f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2077068010"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:39.973112 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d22fa0ef-a884-4475-b292-6f4666e2087c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Getting quotas for project 49054bd529dd4f6da0310f7fe1ef8f58. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:35:39.977017 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d22fa0ef-a884-4475-b292-6f4666e2087c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Getting quotas for user 9af2b19a4b09402b9fc4a945b3c646ea and project 49054bd529dd4f6da0310f7fe1ef8f58. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:35:40.068441 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d22fa0ef-a884-4475-b292-6f4666e2087c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Getting quotas for project 49054bd529dd4f6da0310f7fe1ef8f58. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:35:40.072844 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.quota [None req-d22fa0ef-a884-4475-b292-6f4666e2087c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Getting quotas for user 9af2b19a4b09402b9fc4a945b3c646ea and project 49054bd529dd4f6da0310f7fe1ef8f58. Resources: {'key_pairs'} {{(pid=116162) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:35:40.090556 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-d22fa0ef-a884-4475-b292-6f4666e2087c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.135277 Jan 28 01:35:40.091147 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 578/1149] 10.222.0.16 () {60 vars in 1157 bytes} [Fri Jan 28 01:35:39 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:40.143172 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-295650932", "imageRef": "7fafaec1-fcbd-423b-ac3e-cd6336ff51b3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2077068010", "networks": [{"uuid": "55dc44da-41b8-446e-8e68-a909b0851c74"}]}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:40.195082 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.network.neutron [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] validate_networks() for [('55dc44da-41b8-446e-8e68-a909b0851c74', None, None, None, None, None)] {{(pid=116163) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 28 01:35:40.483169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:40.484939 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:40.495541 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:40.496124 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:40.496883 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:40.497354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:40.964000 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Flavor limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 28 01:35:40.964827 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Image limits 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 28 01:35:40.965818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Flavor pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 28 01:35:40.968890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Image pref 0:0:0 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 28 01:35:40.968890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.virt.hardware [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116163) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 28 01:35:40.978007 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:40.978431 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:40.979504 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:40.979903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:41.003038 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Getting quotas for project 49054bd529dd4f6da0310f7fe1ef8f58. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 28 01:35:41.007736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.quota [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Getting quotas for user 9af2b19a4b09402b9fc4a945b3c646ea and project 49054bd529dd4f6da0310f7fe1ef8f58. Resources: {'instances', 'ram', 'cores'} {{(pid=116163) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 28 01:35:41.010334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:41.020304 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31206354-400a-4eb8-9db9-ad34773aa128 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.545137 Jan 28 01:35:41.022628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Going to run 1 instances... {{(pid=116163) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 28 01:35:41.022867 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 579/1150] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:40 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:41.026299 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7fafaec1-fcbd-423b-ac3e-cd6336ff51b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116163) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 28 01:35:41.083535 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c2618d89-a6c1-4b22-8f02-18eda4ab0fc0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.943316 Jan 28 01:35:41.083535 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 572/1151] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Jan 28 01:35:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 28 01:35:41.094715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fca5e510-b75f-498d-84ad-46d87f458b6f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:41.095339 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fca5e510-b75f-498d-84ad-46d87f458b6f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:41.155457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fca5e510-b75f-498d-84ad-46d87f458b6f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:41.163668 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fca5e510-b75f-498d-84ad-46d87f458b6f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1258 microversion: 2.1 time: 0.072983 Jan 28 01:35:41.164271 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 580/1152] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:41 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1258 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:42.046916 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:42.047924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:42.069550 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:42.070725 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:42.074407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:42.075415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:42.182179 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:42.182821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:42.191152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:42.191610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:42.192393 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:42.192851 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:42.230254 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:42.238564 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d670ad19-2509-4307-95cf-f0c538d83a9b tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.196061 Jan 28 01:35:42.239495 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 573/1153] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:42 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:42.266984 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:42.274807 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-da658ce8-19c0-455d-8a97-07dbaef0be8f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1310 microversion: 2.1 time: 0.096316 Jan 28 01:35:42.275438 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 581/1154] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:42 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:43.267580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:43.269053 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:43.281146 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:43.282176 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:43.283970 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:43.285191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:43.293099 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:43.294062 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:43.319946 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:43.325102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:43.326352 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:43.326977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:43.577019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:43.591769 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-4540e425-ae12-4ba9-b2e5-02eca2972271 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.330230 Jan 28 01:35:43.595208 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 574/1155] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:43 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:43.615298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:43.624930 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b5c08204-97a7-40de-9eea-b747216d369a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.335953 Jan 28 01:35:43.626724 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 582/1156] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:43 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:44.615702 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:44.617161 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:44.628803 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:44.629277 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:44.630092 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:44.631138 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:44.646658 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:44.647342 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:44.653823 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:44.654278 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:44.655087 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:44.655516 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:44.883685 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:44.893284 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-07cbe6e1-5a7e-4b1f-85cf-16398dce31ec tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.283215 Jan 28 01:35:44.894484 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 575/1157] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:44 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:44.915622 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:44.929149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-560a4105-74e9-485e-8606-1aa2bf8eaaf0 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.286082 Jan 28 01:35:44.929849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 583/1158] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:44 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:45.370699 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-5caacf65-c343-4d35-880b-f5cd744a0d61 req-ae27dd1f-322f-4cd2-8f1f-75b97cd086ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "name": "network-vif-unplugged", "status": "completed", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:45.372556 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:35:45.372556 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:35:45.385035 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-5caacf65-c343-4d35-880b-f5cd744a0d61 req-ae27dd1f-322f-4cd2-8f1f-75b97cd086ad service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:45.385834 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-5caacf65-c343-4d35-880b-f5cd744a0d61 req-ae27dd1f-322f-4cd2-8f1f-75b97cd086ad service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:45.431514 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-5caacf65-c343-4d35-880b-f5cd744a0d61 req-ae27dd1f-322f-4cd2-8f1f-75b97cd086ad service nova] Creating event network-vif-unplugged:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:35:45.452429 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-5caacf65-c343-4d35-880b-f5cd744a0d61 req-ae27dd1f-322f-4cd2-8f1f-75b97cd086ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085273 Jan 28 01:35:45.460738 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 576/1159] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:35:45.911804 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:45.912646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:45.922055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:45.922923 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:45.924149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:45.924879 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:45.949395 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:45.951056 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:45.958803 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:45.959528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:45.960789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:45.961444 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:46.166758 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:46.179417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-de1bc83f-70bd-4b81-973b-270dfb049365 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.271430 Jan 28 01:35:46.180264 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 584/1160] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:45 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:46.256621 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:46.265280 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2ef6df5c-def5-4f5e-9b04-fd07b5e07451 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.321538 Jan 28 01:35:46.266031 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 577/1161] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:45 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:47.204183 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:47.204889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:47.211799 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:47.212259 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:47.213073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:47.213586 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:47.283479 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:47.295636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:47.303261 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:47.303722 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:47.304574 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:47.305048 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:47.468442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:47.476245 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6be481a5-83c2-48dc-8f70-bd5d5c51ed0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.275810 Jan 28 01:35:47.477486 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 585/1162] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:47 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:47.556780 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:47.566049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c21ee662-686a-476a-a155-0c5d5e294d53 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.286946 Jan 28 01:35:47.568678 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 578/1163] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:47 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:48.470287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:48.472705 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-807c5119-3678-4885-8783-3fde4fd2876f req-6a3e822a-43eb-49f7-b302-66d5706da222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53", "tag": "416bf0d0-0933-456e-9825-b69e701320a5"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:48.473921 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:48.475831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:35:48.475831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:35:48.491803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.501031 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.502062 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-807c5119-3678-4885-8783-3fde4fd2876f req-6a3e822a-43eb-49f7-b302-66d5706da222 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.502417 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.503108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.503339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-807c5119-3678-4885-8783-3fde4fd2876f req-6a3e822a-43eb-49f7-b302-66d5706da222 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.516257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-807c5119-3678-4885-8783-3fde4fd2876f req-6a3e822a-43eb-49f7-b302-66d5706da222 service nova] Creating event network-changed:416bf0d0-0933-456e-9825-b69e701320a5 for instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 on hv-cinder-82662 Jan 28 01:35:48.523063 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-807c5119-3678-4885-8783-3fde4fd2876f req-6a3e822a-43eb-49f7-b302-66d5706da222 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056962 Jan 28 01:35:48.524636 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 579/1164] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:35:48.533618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:48.534870 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:48.542879 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.543844 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.544889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.554454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.583872 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:35:48.715224 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-951ae370-1b3c-444f-8503-68dc936cd2b4 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 204 len: 0 microversion: 2.1 time: 0.252689 Jan 28 01:35:48.715842 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 586/1165] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:35:48 2022] DELETE /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:35:48.727424 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:48.728137 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:48.734993 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.735175 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.735848 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:48.736626 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:48.994863 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:49.006713 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-72f6a3dd-d860-4f2b-a20e-14bcc5936115 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.480181 Jan 28 01:35:49.013435 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 580/1166] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:48 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:49.022006 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:49.023162 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:49.031337 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:49.032150 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:49.033187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:49.033882 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:49.095853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:49.104278 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-51aa23b1-b9f0-42e8-9b22-9e72160564ae tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.387137 Jan 28 01:35:49.105209 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 587/1167] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:48 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:49.261104 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:49.274899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e13a956b-a670-44bb-9e93-d041f5a9ecd2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1573 microversion: 2.1 time: 0.259372 Jan 28 01:35:49.276114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 581/1168] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:49 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1573 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:50.024007 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:50.024859 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:50.031286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:50.031729 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:50.032515 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:50.032952 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:50.136854 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:50.137842 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:50.167338 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:50.173087 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:50.176057 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:50.179818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:50.204610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:50.215801 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-21a02122-4364-436f-a5c5-ae40cc92078a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.195612 Jan 28 01:35:50.221317 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 588/1169] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:50 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:50.294253 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:50.295043 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:50.303268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:50.303943 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:50.304764 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:50.305821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:50.408684 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:50.420450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-ac11cbc9-b208-4cc4-9685-e10e053a77ef tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.292883 Jan 28 01:35:50.430408 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 582/1170] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:50 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:50.511036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:50.519610 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-83ddcd8f-68ba-4810-8ac7-aa48ea7d09a0 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1573 microversion: 2.1 time: 0.229455 Jan 28 01:35:50.520422 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 589/1171] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:50 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1573 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:51.236118 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:51.244670 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:51.252197 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:51.252584 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:51.253707 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:51.254216 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:51.433522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:51.438874 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:51.439627 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:51.443798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-76a8e884-a78d-4392-848a-bb8af2ae85ea tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.212396 Jan 28 01:35:51.445003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 583/1172] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:51 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:51.448882 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:51.449460 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:51.450326 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:51.450832 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:51.537831 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:51.538924 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:51.546552 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:51.547315 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:51.548501 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:51.549169 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:51.660179 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:51.676185 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-1a7ba152-8dfd-40a3-ae88-d2e490149cf7 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.241492 Jan 28 01:35:51.677180 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 590/1173] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:51 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:51.736628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:51.744646 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-04a77917-5491-4bcc-840b-12329285b4c3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1573 microversion: 2.1 time: 0.211133 Jan 28 01:35:51.745219 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 584/1174] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:51 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1573 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:52.463579 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:52.464456 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:52.473306 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:52.473667 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:52.474446 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:52.474878 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:52.618649 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:52.628296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-02930609-3bd4-4c92-a72a-1faef4815404 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.169723 Jan 28 01:35:52.628873 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 591/1175] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:52 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:52.694089 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:52.694797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:52.703137 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:52.703659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:52.704403 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:52.704880 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:52.762887 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:52.763502 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:52.769617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:52.770067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:52.770860 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:52.771296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:52.874344 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:52.882499 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-6e88db0a-80e5-481c-83bb-9090064ea00a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.192349 Jan 28 01:35:52.883861 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 585/1176] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:52 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:52.948143 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:52.956483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b6130a8d-cfff-45fd-8e24-07e86800605c tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1573 microversion: 2.1 time: 0.197311 Jan 28 01:35:52.957108 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 592/1177] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:52 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1573 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:53.644744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:53.645390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:53.652198 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:53.652647 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:53.653485 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:53.653920 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:53.807334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:53.816356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bf7bb4f9-d575-41d1-8994-e60aa6ad99a6 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.175179 Jan 28 01:35:53.817131 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 586/1178] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:53 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:53.901979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:53.902600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:53.909743 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:53.910197 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:53.910969 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:53.911400 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:53.977356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:53.978004 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:53.984515 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:53.985113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:53.986195 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:53.986810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:54.095773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:54.104023 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ee3b386d-e2bc-4e08-a6ff-41d5cbf4fadd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.206857 Jan 28 01:35:54.104643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 593/1179] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:53 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:54.170479 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:54.178949 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e0ba6359-215a-45ec-89a9-72b315e38332 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1573 microversion: 2.1 time: 0.205842 Jan 28 01:35:54.179798 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 587/1180] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:53 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:54.835074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:54.835828 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:54.846747 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:54.847917 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:54.849459 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:54.850088 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:55.123040 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:55.124392 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:55.131851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:55.132390 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:55.133765 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:55.134425 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:55.292215 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:55.300698 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-53d9c3b7-6c79-42de-aa16-2e5779b4e179 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.469498 Jan 28 01:35:55.301641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 594/1181] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:54 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:55.315557 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:55.316286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:55.323453 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:55.323913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:55.324820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:55.325382 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:55.508608 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:55.524059 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-52f7913c-6fae-4a23-944c-4459f9560b50 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.405422 Jan 28 01:35:55.525175 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 588/1182] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:55 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:55.659856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:55.668509 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-ff7edd97-d02a-45a7-add8-3b7da3a559e3 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1573 microversion: 2.1 time: 0.356760 Jan 28 01:35:55.669464 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 595/1183] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:55 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1573 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:55.806622 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-3ae7a500-b277-4c86-bf45-54e39d53b2ee req-a60d81a6-f3ef-47d5-9d95-b3e20e972c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:55.808324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:35:55.808324 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:35:55.819273 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-3ae7a500-b277-4c86-bf45-54e39d53b2ee req-a60d81a6-f3ef-47d5-9d95-b3e20e972c49 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:55.819640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-3ae7a500-b277-4c86-bf45-54e39d53b2ee req-a60d81a6-f3ef-47d5-9d95-b3e20e972c49 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:55.834368 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-3ae7a500-b277-4c86-bf45-54e39d53b2ee req-a60d81a6-f3ef-47d5-9d95-b3e20e972c49 service nova] Creating event network-changed:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:35:55.843506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-3ae7a500-b277-4c86-bf45-54e39d53b2ee req-a60d81a6-f3ef-47d5-9d95-b3e20e972c49 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.247357 Jan 28 01:35:55.845441 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 589/1184] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:35:56.319806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:56.320616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:56.329292 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.329803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.330646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.331294 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.543024 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:56.543925 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:56.554267 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.555071 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.556967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.557970 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.587737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:56.596899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6218d39a-0eb8-40d5-aa8c-b2ab15510943 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1509 microversion: 2.1 time: 0.282373 Jan 28 01:35:56.597536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 596/1185] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:56 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:56.622857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:56.623733 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:56.633683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.633683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.634656 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.635334 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.744638 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-788b6039-7723-42b2-8037-61ef0ebd03f2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "POST /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e/action" status: 202 len: 0 microversion: 2.1 time: 0.127241 Jan 28 01:35:56.745332 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 597/1186] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:35:56 2022] POST /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:35:56.751805 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:56.752423 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:56.759970 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.760350 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.761061 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.761605 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.812083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:56.827044 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-9c839bdd-943f-4910-a1bc-bb41219f02c1 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.288265 Jan 28 01:35:56.828389 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 590/1187] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:56 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:56.837654 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:56.838995 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:56.845950 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.846690 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:56.847661 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:56.848257 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:57.560746 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:57.569684 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-33de4f1b-9615-4ded-8968-1c5d85d0f729 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1456 microversion: 2.1 time: 0.822648 Jan 28 01:35:57.570489 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 598/1188] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:56 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1456 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:57.603888 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:57.616659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-3573f4eb-1408-4c38-9375-f3724ba8cb0f tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1517 microversion: 2.1 time: 0.783084 Jan 28 01:35:57.617580 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 591/1189] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:56 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1517 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:57.852252 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:57.853380 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:57.861847 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:57.862543 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:57.864101 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:57.865689 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:57.935121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-4bf5ee74-37b2-4aca-8b95-9468f0d5e972 req-b0a231b5-c00a-4fa8-a814-343b85edb7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53", "name": "network-vif-deleted", "tag": "416bf0d0-0933-456e-9825-b69e701320a5"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:35:57.937342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:35:57.937342 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:35:57.947825 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-4bf5ee74-37b2-4aca-8b95-9468f0d5e972 req-b0a231b5-c00a-4fa8-a814-343b85edb7ed service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:57.948265 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-4bf5ee74-37b2-4aca-8b95-9468f0d5e972 req-b0a231b5-c00a-4fa8-a814-343b85edb7ed service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:57.961944 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-4bf5ee74-37b2-4aca-8b95-9468f0d5e972 req-b0a231b5-c00a-4fa8-a814-343b85edb7ed service nova] Creating event network-vif-deleted:416bf0d0-0933-456e-9825-b69e701320a5 for instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 on hv-cinder-82662 Jan 28 01:35:57.968264 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-4bf5ee74-37b2-4aca-8b95-9468f0d5e972 req-b0a231b5-c00a-4fa8-a814-343b85edb7ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038749 Jan 28 01:35:57.969036 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 592/1190] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:35:58.046452 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:58.054585 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-34558b57-5ffd-4f4d-9c20-c01ae46afbfb tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.208597 Jan 28 01:35:58.055177 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 599/1191] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:57 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:58.592588 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:58.593144 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:58.600415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:58.600861 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:58.601849 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:58.602121 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:58.634771 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:58.636094 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:58.643287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:58.643737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:58.644661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:58.645073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:58.668313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:58.676230 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-87f0dd43-ed17-4c55-8d3c-dc8a622270f9 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 200 len: 1224 microversion: 2.1 time: 0.087999 Jan 28 01:35:58.676815 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 593/1192] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:58 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:58.798881 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:58.806874 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4c1e8165-87fe-4c83-9156-7207bc7e1805 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1519 microversion: 2.1 time: 0.175865 Jan 28 01:35:58.807457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 600/1193] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:58 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:35:59.074597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:59.075450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:59.084367 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:59.084814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:59.085860 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:59.086534 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:59.242731 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:35:59.251685 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-53b122d9-c194-4d92-a6ed-33face9605c9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.182560 Jan 28 01:35:59.252322 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 594/1194] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:59 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:35:59.695403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:59.696449 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:59.705853 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:59.706298 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:59.707470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:59.707903 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:59.724826 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] HTTP exception thrown: Instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 could not be found. Jan 28 01:35:59.725473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Returning 404 to user: Instance f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:35:59.726325 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6b6b9bd7-b6cc-4f78-b8b0-15656e5ccefd tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53" status: 404 len: 111 microversion: 2.1 time: 0.035720 Jan 28 01:35:59.726960 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 601/1195] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:59 2022] GET /compute/v2.1/servers/f4e8cb8b-7e5f-4f5c-bb63-59ed8b41fc53 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:35:59.827623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:35:59.829373 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:35:59.838752 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:59.840269 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:35:59.841890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:35:59.850708 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:00.085952 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:00.094973 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-7f4b2e76-f17b-4b0b-8380-7914f8b9395c tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.272734 Jan 28 01:36:00.095968 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 595/1196] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:35:59 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:00.269589 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:00.270199 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:00.276620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:00.277060 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:00.277881 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:00.278319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:00.452288 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:00.465276 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-31b8c405-5ca4-46d9-b612-f7c9998d5a5e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.199364 Jan 28 01:36:00.465935 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 602/1197] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:00 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:01.113061 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:01.113676 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:01.120356 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:01.120832 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:01.121642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:01.122078 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:01.260877 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:01.268963 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-1d9123b1-50ff-4eef-aacd-8d30e8b629ac tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.159765 Jan 28 01:36:01.269571 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 596/1198] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:01 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:01.482588 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:01.483251 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:01.489704 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:01.490488 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:01.490927 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-49ddc2db-76b1-4607-8e7a-945d9ef6f96a req-b435235d-b8a0-483c-943e-3f721873e792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "name": "network-vif-plugged", "status": "completed", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:01.491250 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:01.491678 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:01.492890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:01.492890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:36:01.500640 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-49ddc2db-76b1-4607-8e7a-945d9ef6f96a req-b435235d-b8a0-483c-943e-3f721873e792 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:01.501206 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-49ddc2db-76b1-4607-8e7a-945d9ef6f96a req-b435235d-b8a0-483c-943e-3f721873e792 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:01.513537 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-49ddc2db-76b1-4607-8e7a-945d9ef6f96a req-b435235d-b8a0-483c-943e-3f721873e792 service nova] Creating event network-vif-plugged:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:36:01.518825 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-49ddc2db-76b1-4607-8e7a-945d9ef6f96a req-b435235d-b8a0-483c-943e-3f721873e792 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031958 Jan 28 01:36:01.519873 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 597/1199] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:01.640482 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:01.648081 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-73e930d4-1db5-462f-9687-ae517fcd9109 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.169236 Jan 28 01:36:01.648660 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 603/1200] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:01 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:02.291740 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:02.292445 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:02.299530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:02.299530 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:02.300359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:02.300789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:02.517174 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:02.528409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e07afa48-c049-499f-b431-a244e0ee334e tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.241292 Jan 28 01:36:02.529407 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 598/1201] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:02 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:02.664073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:02.664701 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:02.675580 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:02.676426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:02.677691 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:02.678404 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:02.957327 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:02.967776 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-bee8e4bc-93df-4e9d-b283-80d011c2219a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1358 microversion: 2.1 time: 0.307353 Jan 28 01:36:02.968379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 604/1202] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:02 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:03.168406 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-82618ac8-963e-4edf-986f-e8d7df5daa0d req-a683e346-6ec3-4534-8b92-8907333b5402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6159fd6-8aec-48d1-a5bf-931de7eaabf0", "tag": "dd10330d-4479-4215-a738-88665cbe112f"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:03.172814 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:03.173369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:03.175942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:03.175942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:36:03.185379 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-82618ac8-963e-4edf-986f-e8d7df5daa0d req-a683e346-6ec3-4534-8b92-8907333b5402 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.185849 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-82618ac8-963e-4edf-986f-e8d7df5daa0d req-a683e346-6ec3-4534-8b92-8907333b5402 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.191478 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.194890 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.198374 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-82618ac8-963e-4edf-986f-e8d7df5daa0d req-a683e346-6ec3-4534-8b92-8907333b5402 service nova] Creating event network-changed:dd10330d-4479-4215-a738-88665cbe112f for instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 on hv-cinder-82662 Jan 28 01:36:03.199381 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.200164 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.204560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-82618ac8-963e-4edf-986f-e8d7df5daa0d req-a683e346-6ec3-4534-8b92-8907333b5402 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Jan 28 01:36:03.204994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 605/1203] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:03.252681 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:36:03.361910 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-e21cabc7-5abf-4cdb-9aa7-5da037fc52d2 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 204 len: 0 microversion: 2.1 time: 0.198422 Jan 28 01:36:03.366689 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 599/1204] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:36:03 2022] DELETE /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:36:03.372261 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:03.372976 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:03.382079 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.382528 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.383356 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.383770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.557065 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:03.557951 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:03.569865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.570303 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.571318 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.573409 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.614083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:03.625770 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-664a096d-424c-4b75-851f-a257f85d81de tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1576 microversion: 2.1 time: 0.258355 Jan 28 01:36:03.631750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 606/1205] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:03 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:36:03.826085 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:03.834046 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a4b86069-4989-4d65-b9a0-6ad0f09d7a65 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.281183 Jan 28 01:36:03.835058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 600/1206] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:03 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:36:03.984715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:03.985546 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:03.994725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.996942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:03.997981 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:03.998434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.165202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:04.174720 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0fc35dd4-4219-422f-804a-70d1a3e3b48c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1548 microversion: 2.1 time: 0.193457 Jan 28 01:36:04.175473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 607/1207] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:03 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1548 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:04.200865 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:04.201841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:04.208889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.209889 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.211513 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.211826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.374622 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:04.382655 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-15065a6a-9b73-47fd-b134-2c91574452bc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1548 microversion: 2.1 time: 0.188539 Jan 28 01:36:04.383349 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 601/1208] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:04 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:04.399034 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:04.402711 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:04.402711 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:36:04.403809 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:04.404618 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Searching by: {'deleted': False, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58'} {{(pid=116162) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 28 01:36:04.415782 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.416249 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.417405 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.417884 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.509920 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.multi_cell_list [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116162) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 28 01:36:04.609805 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-269b87ca-94c8-407a-b403-37e24566fb26 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214582 Jan 28 01:36:04.610544 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 608/1209] 10.222.0.16 () {58 vars in 1124 bytes} [Fri Jan 28 01:36:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:04.620496 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:04.621118 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:04.629808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.629808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.629808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.629808 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.643804 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:04.644920 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:04.651047 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.651494 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.652291 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.652750 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.862507 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:04.870956 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2cd74bc5-1866-401b-9fd3-3bb8dcba93cd tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1548 microversion: 2.1 time: 0.254209 Jan 28 01:36:04.871556 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 602/1210] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:04 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1548 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:36:04.885851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:04.885851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:04.885851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.885851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.887359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:04.887359 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:04.912364 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:04.926663 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-246e4c15-1460-4f36-bd88-d2b8b0ec4731 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1457 microversion: 2.1 time: 0.286870 Jan 28 01:36:04.936290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 609/1211] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:04 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1457 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:36:05.083043 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:05.095396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d841b83e-0e83-4510-b6c8-16ddd9960b95 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.222733 Jan 28 01:36:05.096614 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 603/1212] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:04 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:05.940868 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-800766e2-a34a-41e1-bfbf-84ae29fb832d req-2a5ce858-785f-4e10-93da-b92b14e702c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6159fd6-8aec-48d1-a5bf-931de7eaabf0", "name": "network-vif-deleted", "tag": "dd10330d-4479-4215-a738-88665cbe112f"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:05.943292 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:05.943292 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:36:05.949398 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:05.951736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:05.952098 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-800766e2-a34a-41e1-bfbf-84ae29fb832d req-2a5ce858-785f-4e10-93da-b92b14e702c8 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:05.952553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-800766e2-a34a-41e1-bfbf-84ae29fb832d req-2a5ce858-785f-4e10-93da-b92b14e702c8 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:05.957591 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:05.957972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:05.961160 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:05.961160 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:05.964389 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-800766e2-a34a-41e1-bfbf-84ae29fb832d req-2a5ce858-785f-4e10-93da-b92b14e702c8 service nova] Creating event network-vif-deleted:dd10330d-4479-4215-a738-88665cbe112f for instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 on hv-cinder-82662 Jan 28 01:36:05.969723 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-800766e2-a34a-41e1-bfbf-84ae29fb832d req-2a5ce858-785f-4e10-93da-b92b14e702c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034943 Jan 28 01:36:05.970331 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 610/1213] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:06.034148 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b11396acc67415abb08ddddf5680df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12da7c52708b49e8827fb30ea43f8e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:06.042110 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-c179d839-eb41-4269-bc7d-5613d20c787a tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 200 len: 1390 microversion: 2.1 time: 0.097832 Jan 28 01:36:06.042743 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 604/1214] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:05 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:36:06.115922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:06.116621 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:06.123942 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:06.124402 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:06.125207 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:06.125705 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:06.295644 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:06.306244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-4bf47aa0-bb36-46f9-8d70-3ac314c82671 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.194315 Jan 28 01:36:06.307484 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 611/1215] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:06 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:06.527659 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ada20273-9baa-4f8b-a393-db1e921a14ed"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:06.529003 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:06.538551 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:06.539375 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:06.540488 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:06.541278 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:06.841829 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-0233a04f-592b-4aef-b3a2-9df6f95f0d5f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319152 Jan 28 01:36:06.842446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 605/1216] 10.222.0.16 () {60 vars in 1322 bytes} [Fri Jan 28 01:36:06 2022] POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:07.059840 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:07.060423 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: a6159fd6-8aec-48d1-a5bf-931de7eaabf0] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:07.067901 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.068385 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.069174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.069643 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.085692 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] HTTP exception thrown: Instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 could not be found. Jan 28 01:36:07.086297 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Returning 404 to user: Instance a6159fd6-8aec-48d1-a5bf-931de7eaabf0 could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:36:07.087129 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-8d0d7f94-1984-4468-b2cb-87befb217c2f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0" status: 404 len: 111 microversion: 2.1 time: 0.031523 Jan 28 01:36:07.087773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 612/1217] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:07 2022] GET /compute/v2.1/servers/a6159fd6-8aec-48d1-a5bf-931de7eaabf0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:36:07.325223 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:07.326331 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:07.332812 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.333611 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.334415 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.334843 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.487352 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:07.497164 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-033031cc-491e-4af9-94e3-09e9880f58be tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.176869 Jan 28 01:36:07.498578 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 606/1218] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:07 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:07.610562 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:07.611074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:07.618029 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.618601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.619431 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.619871 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.634592 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] HTTP exception thrown: Instance 127a036c-acd2-4297-82f5-1e41ca62c5bf could not be found. Jan 28 01:36:07.635457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Returning 404 to user: Instance 127a036c-acd2-4297-82f5-1e41ca62c5bf could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:36:07.636661 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6b872ca7-9bd6-4990-953a-af028fbfe159 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "DELETE /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 404 len: 111 microversion: 2.1 time: 0.029733 Jan 28 01:36:07.637434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 613/1219] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:36:07 2022] DELETE /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:36:07.647601 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:07.648223 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] [instance: 127a036c-acd2-4297-82f5-1e41ca62c5bf] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:07.654648 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.655100 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.655903 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:07.656339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:07.670446 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] HTTP exception thrown: Instance 127a036c-acd2-4297-82f5-1e41ca62c5bf could not be found. Jan 28 01:36:07.671049 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Returning 404 to user: Instance 127a036c-acd2-4297-82f5-1e41ca62c5bf could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:36:07.671885 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-393019cb-349b-4a21-9ded-a5282dfd2e82 tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf" status: 404 len: 111 microversion: 2.1 time: 0.029522 Jan 28 01:36:07.672455 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 607/1220] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:07 2022] GET /compute/v2.1/servers/127a036c-acd2-4297-82f5-1e41ca62c5bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:36:08.514864 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:08.515473 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:08.522619 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:08.523102 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:08.523890 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:08.524325 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:08.668632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:08.676758 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-6eff31cc-d035-4636-a056-f432ddd91c64 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.165610 Jan 28 01:36:08.677351 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 614/1221] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:08 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:08.967618 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-53ade4e0-9485-4ac0-b98f-57f2790bb27f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] Calling method '.version_select at 0x7f7e76f320d0>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:08.996158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-53ade4e0-9485-4ac0-b98f-57f2790bb27f tempest-TestVolumeBootPattern-697861174 tempest-TestVolumeBootPattern-697861174-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-423439306" status: 202 len: 0 microversion: 2.1 time: 0.031821 Jan 28 01:36:08.996158 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 608/1222] 10.222.0.16 () {58 vars in 1259 bytes} [Fri Jan 28 01:36:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-423439306 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:36:09.663060 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-9b57c016-b47c-4140-a315-4fbc53f9c2f3 req-f01ab23e-a4e6-49f7-8208-0da0c4edfd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "name": "network-vif-plugged", "status": "completed", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:09.664620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:09.664620 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:36:09.671877 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-9b57c016-b47c-4140-a315-4fbc53f9c2f3 req-f01ab23e-a4e6-49f7-8208-0da0c4edfd58 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:09.672320 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-9b57c016-b47c-4140-a315-4fbc53f9c2f3 req-f01ab23e-a4e6-49f7-8208-0da0c4edfd58 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:09.687536 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-9b57c016-b47c-4140-a315-4fbc53f9c2f3 req-f01ab23e-a4e6-49f7-8208-0da0c4edfd58 service nova] Creating event network-vif-plugged:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:36:09.693717 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-9b57c016-b47c-4140-a315-4fbc53f9c2f3 req-f01ab23e-a4e6-49f7-8208-0da0c4edfd58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172904 Jan 28 01:36:09.694746 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 615/1223] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:09.695719 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:09.696643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:09.707191 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:09.707773 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:09.708642 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:09.709137 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:09.863300 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:09.879141 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-d47ae51e-c96d-4528-aab7-be3b0570bcd2 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.188400 Jan 28 01:36:09.880188 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 609/1224] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:09 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:36:10.898777 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:10.899862 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:10.909824 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:10.910722 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:10.911654 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:10.912170 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:11.060420 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:11.071617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-28a405b3-a739-4472-b116-75b98a3dfcf8 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1575 microversion: 2.1 time: 0.177582 Jan 28 01:36:11.073046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 616/1225] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:10 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:12.089985 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:12.091334 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:12.104689 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:12.107588 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:12.112651 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:12.113625 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:12.400522 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:12.409314 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-41bc174a-7c63-499a-b3a2-bed6ddd805c7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1562 microversion: 2.1 time: 0.323254 Jan 28 01:36:12.434868 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 610/1226] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:12 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1562 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:14.469632 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:14.470239 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:14.477560 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:14.478015 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:14.478783 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:14.479213 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:14.699319 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:14.707113 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-dfb4cac8-8109-441a-a59c-c2ba4706dd57 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1594 microversion: 2.1 time: 0.241120 Jan 28 01:36:14.707671 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 617/1227] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:14 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1594 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:17.623662 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-bbfbfeb7-d38c-4b2b-b873-f625b31e3ce4 req-3bf33ef3-f795-430e-9e5a-256910b0adce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:17.628619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:17.628619 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:36:17.648500 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-bbfbfeb7-d38c-4b2b-b873-f625b31e3ce4 req-3bf33ef3-f795-430e-9e5a-256910b0adce service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:17.649528 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-bbfbfeb7-d38c-4b2b-b873-f625b31e3ce4 req-3bf33ef3-f795-430e-9e5a-256910b0adce service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:17.687441 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-bbfbfeb7-d38c-4b2b-b873-f625b31e3ce4 req-3bf33ef3-f795-430e-9e5a-256910b0adce service nova] Creating event network-changed:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:36:17.701623 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-bbfbfeb7-d38c-4b2b-b873-f625b31e3ce4 req-3bf33ef3-f795-430e-9e5a-256910b0adce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088068 Jan 28 01:36:17.703602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 611/1228] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:18.988553 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2052012284"}} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:18.989841 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:19.001117 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:19.001936 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:19.003290 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:19.004046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:19.149082 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.network.security_group_api [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Adding security group 7b20f7aa-6eb8-4ec1-897f-4767df4c99ad to port 64bd017a-e349-4294-8b50-45882cd1509b Jan 28 01:36:19.506161 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cedb2e19-1d79-413e-8f1b-1de0ae3c1cc6 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/action" status: 202 len: 0 microversion: 2.1 time: 0.524504 Jan 28 01:36:19.507595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 618/1229] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:36:18 2022] POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:36:19.520518 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-fa886c77-43b2-43d0-ba68-c990e01b5d0e req-df9ff025-0dcb-49a5-9589-32dd4c7a0e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:19.525967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:36:19.525967 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:36:19.527055 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:19.529166 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:19.545470 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:19.546595 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:19.547977 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:19.548455 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:19.553609 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-fa886c77-43b2-43d0-ba68-c990e01b5d0e req-df9ff025-0dcb-49a5-9589-32dd4c7a0e61 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:19.554111 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-fa886c77-43b2-43d0-ba68-c990e01b5d0e req-df9ff025-0dcb-49a5-9589-32dd4c7a0e61 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:19.577064 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-fa886c77-43b2-43d0-ba68-c990e01b5d0e req-df9ff025-0dcb-49a5-9589-32dd4c7a0e61 service nova] Creating event network-changed:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:36:19.595339 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-fa886c77-43b2-43d0-ba68-c990e01b5d0e req-df9ff025-0dcb-49a5-9589-32dd4c7a0e61 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078627 Jan 28 01:36:19.600090 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 612/1230] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:36:19.887219 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:19.898806 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0409ed36-87e9-4e74-84e2-cbbea015583e tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1759 microversion: 2.1 time: 0.384178 Jan 28 01:36:19.900285 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 619/1231] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:19 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1759 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:43.514429 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:36:43.515755 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:43.523019 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:43.523473 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:43.524238 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:43.524657 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:43.605073 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bd4bd5d5-4732-431e-9b40-0942261a5a64 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/action" status: 202 len: 0 microversion: 2.1 time: 0.095068 Jan 28 01:36:43.605763 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 613/1232] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:36:43 2022] POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:36:43.617980 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:43.618633 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:43.626813 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:43.627279 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:43.628074 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:43.628520 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:43.812211 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:43.821487 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-019ffa0c-62a0-46cc-ab33-069ff37a27ec tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1751 microversion: 2.1 time: 0.210349 Jan 28 01:36:43.822076 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 620/1233] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:43 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:44.841260 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:44.842030 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:44.848493 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:44.848972 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:44.849751 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:44.850263 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:45.023042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:45.031176 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-89110f5e-c034-462f-b914-b4a7b84e3f74 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.194613 Jan 28 01:36:45.031754 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 614/1234] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:44 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:46.050116 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:46.051110 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:46.058019 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:46.058445 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:46.059286 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:46.059714 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:46.217426 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:46.228457 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-472fc650-f042-43bd-9617-a8fc7fd4fa0c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.182467 Jan 28 01:36:46.229010 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 621/1235] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:46 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:47.245913 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:47.246593 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:47.253336 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:47.253783 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:47.254572 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:47.254978 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:47.406255 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:47.416154 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-8def1f33-a34e-49e5-8ebd-924af9206df9 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.174028 Jan 28 01:36:47.416839 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 615/1236] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:47 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:48.434429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:48.435058 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:48.442403 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:48.442852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:48.443638 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:48.444069 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:48.595083 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:48.604149 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b8a33675-07f9-4a0b-ab8c-b71671b78931 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.173682 Jan 28 01:36:48.604725 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 622/1237] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:48 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:49.621788 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:49.622481 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:49.629523 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:49.629981 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:49.630898 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:49.631187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:49.784822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:49.793187 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-bde8cb39-49f2-4c0f-b9ae-18a185db9eb3 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.175121 Jan 28 01:36:49.793791 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 616/1238] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:49 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:50.810760 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:50.811416 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:50.818972 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:50.819600 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:50.820478 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:50.821341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:50.971857 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:50.984119 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-061fadae-a41c-448b-b0b3-362751fbf270 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.176785 Jan 28 01:36:50.984874 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 623/1239] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:50 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:52.002710 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:52.003379 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:52.010377 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:52.010821 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:52.011613 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:52.012042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:52.169739 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:52.178147 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-5ba15c0e-3c6e-40eb-95a6-2a0947323795 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.179452 Jan 28 01:36:52.178718 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 617/1240] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:51 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:53.195820 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:53.196803 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:53.205571 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:53.206063 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:53.206834 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:53.207261 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:53.363994 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:53.373979 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-7dfb1dff-32df-4854-9436-c35bc58d479a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.181503 Jan 28 01:36:53.374755 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 624/1241] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:53 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:54.393606 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:54.394231 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:54.401058 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:54.401534 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:54.402313 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:54.402744 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:54.574810 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:54.584271 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-dd025b13-5739-4811-9be1-1fba64fca685 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1756 microversion: 2.1 time: 0.195261 Jan 28 01:36:54.584851 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 618/1242] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:54 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:36:55.601642 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:36:55.602283 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:36:55.608913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:55.609394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:55.610167 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:36:55.610602 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:36:55.755916 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:36:55.763846 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-74edf3cd-5ba4-4663-9dd6-526e82833226 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1759 microversion: 2.1 time: 0.165940 Jan 28 01:36:55.764382 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 625/1243] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:36:55 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1759 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:37:29.487869 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2052012284"}} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:37:29.488551 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:29.494954 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:29.495396 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:29.496178 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:29.496602 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:29.638055 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.network.security_group_api [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Removing security group 7b20f7aa-6eb8-4ec1-897f-4767df4c99ad from port 64bd017a-e349-4294-8b50-45882cd1509b Jan 28 01:37:29.992818 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-fc3dd595-b397-4f23-acf3-a6056b07a1de tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/action" status: 202 len: 0 microversion: 2.1 time: 0.508803 Jan 28 01:37:30.001878 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 619/1244] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Jan 28 01:37:29 2022] POST /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:37:30.011284 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-24c8e2e5-371d-4b5b-9766-2b92088be87a req-3649a466-6b1d-49cc-b257-952533929df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:37:30.018202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:37:30.018202 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:37:30.051044 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-24c8e2e5-371d-4b5b-9766-2b92088be87a req-3649a466-6b1d-49cc-b257-952533929df0 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:30.051883 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-24c8e2e5-371d-4b5b-9766-2b92088be87a req-3649a466-6b1d-49cc-b257-952533929df0 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:30.065734 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-24c8e2e5-371d-4b5b-9766-2b92088be87a req-3649a466-6b1d-49cc-b257-952533929df0 service nova] Creating event network-changed:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:37:30.075341 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-24c8e2e5-371d-4b5b-9766-2b92088be87a req-3649a466-6b1d-49cc-b257-952533929df0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071020 Jan 28 01:37:30.077434 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 626/1245] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:37:31.165001 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:31.166354 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:31.175133 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:31.175747 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:31.176841 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:31.177597 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:31.283295 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.objects.instance [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lazy-loading 'services' on Instance uuid 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef {{(pid=116163) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:37:31.331781 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-ed4244a7-f966-42e4-aa5f-9a65d81659c4 req-2ec11638-e5d0-4869-9bfd-d8c3b595175f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:37:31.333905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:37:31.333905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:37:31.342204 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ed4244a7-f966-42e4-aa5f-9a65d81659c4 req-2ec11638-e5d0-4869-9bfd-d8c3b595175f service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:31.342897 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-ed4244a7-f966-42e4-aa5f-9a65d81659c4 req-2ec11638-e5d0-4869-9bfd-d8c3b595175f service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:31.354922 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-ed4244a7-f966-42e4-aa5f-9a65d81659c4 req-2ec11638-e5d0-4869-9bfd-d8c3b595175f service nova] Creating event network-changed:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:37:31.364138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-ed4244a7-f966-42e4-aa5f-9a65d81659c4 req-2ec11638-e5d0-4869-9bfd-d8c3b595175f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197026 Jan 28 01:37:31.365650 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 627/1246] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:37:31.377045 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-2ef9a1d0-2b57-4f2f-8ec1-4b3a2b139c2a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments/ada20273-9baa-4f8b-a393-db1e921a14ed" status: 202 len: 0 microversion: 2.1 time: 0.215955 Jan 28 01:37:31.377762 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 620/1247] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:37:31 2022] DELETE /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments/ada20273-9baa-4f8b-a393-db1e921a14ed => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:37:31.387010 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:31.388044 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:31.394407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:31.394856 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:31.395646 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:31.396073 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:31.427793 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-cff55e22-4c93-494c-9f5c-1ba6167b6e4f tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Jan 28 01:37:31.428497 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 628/1248] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:37:31 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:37:32.389042 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:32.389641 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:32.390204 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-af983891-11b6-40f7-93de-a502718a705a req-b964f57d-2317-4079-9424-2e316b448e3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:37:32.392899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:37:32.392899 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:37:32.403410 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-af983891-11b6-40f7-93de-a502718a705a req-b964f57d-2317-4079-9424-2e316b448e3d service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.404169 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-af983891-11b6-40f7-93de-a502718a705a req-b964f57d-2317-4079-9424-2e316b448e3d service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.405268 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.405736 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.406525 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.406957 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.418315 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-af983891-11b6-40f7-93de-a502718a705a req-b964f57d-2317-4079-9424-2e316b448e3d service nova] Creating event network-changed:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:37:32.423442 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-af983891-11b6-40f7-93de-a502718a705a req-b964f57d-2317-4079-9424-2e316b448e3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037273 Jan 28 01:37:32.424285 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 629/1249] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:37:32.440687 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:32.442224 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:32.445819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Going to try to terminate instance {{(pid=116163) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:37:32.450030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.450761 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.451790 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.452411 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.489959 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-0a7a24a4-c0a8-4189-827e-bae87b72a7da tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053465 Jan 28 01:37:32.500881 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 630/1250] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:37:32 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:37:32.552454 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-233f688a-4bed-4244-8c57-ee2eb467979a tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 204 len: 0 microversion: 2.1 time: 0.167435 Jan 28 01:37:32.553605 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 621/1251] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:37:32 2022] DELETE /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:37:32.563889 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:32.565141 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:32.572287 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.573821 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.575639 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:32.576281 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:32.807652 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:32.821732 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-2ba9da79-989d-47eb-b206-50ca2534b9d5 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1568 microversion: 2.1 time: 0.263001 Jan 28 01:37:32.822917 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 631/1252] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:32 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1568 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:37:33.508519 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:33.509899 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:33.516826 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:33.517427 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:33.518226 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:33.518669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:33.556822 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-aaf5fd47-1a15-4b94-a165-6921060bf473 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052793 Jan 28 01:37:33.557804 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 622/1253] 10.222.0.16 () {58 vars in 1301 bytes} [Fri Jan 28 01:37:33 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 28 01:37:33.568120 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:33.568737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:33.575965 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:33.576421 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:33.577256 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:33.577737 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:33.662694 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] HTTP exception thrown: Instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef is not attached to volume ada20273-9baa-4f8b-a393-db1e921a14ed Jan 28 01:37:33.663296 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Returning 404 to user: Instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef is not attached to volume ada20273-9baa-4f8b-a393-db1e921a14ed {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:37:33.664138 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-df3bf1b4-c663-4fd1-91b8-3b8dd67fbd0a tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments/ada20273-9baa-4f8b-a393-db1e921a14ed" status: 404 len: 154 microversion: 2.1 time: 0.100256 Jan 28 01:37:33.664696 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 632/1254] 10.222.0.16 () {58 vars in 1415 bytes} [Fri Jan 28 01:37:33 2022] DELETE /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef/os-volume_attachments/ada20273-9baa-4f8b-a393-db1e921a14ed => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:37:33.840672 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:33.841343 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:33.849724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:33.850516 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:33.851329 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:33.851771 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:34.003800 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:34.011894 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-62ec5a78-f1e4-44bd-923e-c8d5dc7b92d7 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1450 microversion: 2.1 time: 0.175266 Jan 28 01:37:34.012506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 623/1255] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:33 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:37:34.806858 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:34.807418 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:34.814174 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:34.814625 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:34.815407 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:34.815845 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:34.841429 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Going to try to terminate instance {{(pid=116162) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 28 01:37:34.925665 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-77f566ea-6e4a-40f7-852a-2d9897157bbc tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 204 len: 0 microversion: 2.1 time: 0.122110 Jan 28 01:37:34.926326 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 633/1256] 10.222.0.16 () {58 vars in 1238 bytes} [Fri Jan 28 01:37:34 2022] DELETE /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 28 01:37:34.934506 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:34.935114 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:34.941953 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:34.942413 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:34.943232 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:34.943669 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:35.029868 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:35.030715 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:35.036913 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:35.037444 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:35.038220 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:35.038653 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:35.153277 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64e0bc6be0d64ad794b70b72e9ac551e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '842618ac233949f9bbd304fc37feff56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:35.161067 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-e451f49b-c923-4d07-b885-c0e64232d815 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 200 len: 1383 microversion: 2.1 time: 0.135499 Jan 28 01:37:35.162268 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 634/1257] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:35 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 1383 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:37:35.195506 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [req-c381edc9-96b4-4f4d-abc0-c23a1d074f68 req-47a7fff9-befd-43bf-98bb-d662fc6b2d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e28f7e-f8f3-4b0a-a707-793d663d1a9e", "name": "network-vif-deleted", "tag": "b2f30b1e-44c0-4eb0-9a99-57d3bee29a36"}]} {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:37:35.198534 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:37:35.198534 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: warnings.warn(msg) Jan 28 01:37:35.209861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-c381edc9-96b4-4f4d-abc0-c23a1d074f68 req-47a7fff9-befd-43bf-98bb-d662fc6b2d31 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:35.209861 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [req-c381edc9-96b4-4f4d-abc0-c23a1d074f68 req-47a7fff9-befd-43bf-98bb-d662fc6b2d31 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:35.222571 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.compute.server_external_events [req-c381edc9-96b4-4f4d-abc0-c23a1d074f68 req-47a7fff9-befd-43bf-98bb-d662fc6b2d31 service nova] Creating event network-vif-deleted:b2f30b1e-44c0-4eb0-9a99-57d3bee29a36 for instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e on hv-cinder-82662 Jan 28 01:37:35.228749 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:35.229015 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [req-c381edc9-96b4-4f4d-abc0-c23a1d074f68 req-47a7fff9-befd-43bf-98bb-d662fc6b2d31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039618 Jan 28 01:37:35.229683 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 635/1258] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 28 01:37:35.237643 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-521b4262-4904-45f9-bca8-724c637573a8 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1554 microversion: 2.1 time: 0.306980 Jan 28 01:37:35.238450 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 624/1259] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:34 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 28 01:37:36.181366 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:36.182031 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] [instance: 81e28f7e-f8f3-4b0a-a707-793d663d1a9e] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:36.188616 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:36.189070 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:36.189905 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:36.190373 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:36.206437 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.wsgi [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] HTTP exception thrown: Instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e could not be found. Jan 28 01:37:36.207051 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Returning 404 to user: Instance 81e28f7e-f8f3-4b0a-a707-793d663d1a9e could not be found. {{(pid=116162) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:37:36.207882 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-5992bd5f-026a-408d-9ad5-955c785dedfd tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e" status: 404 len: 111 microversion: 2.1 time: 0.031237 Jan 28 01:37:36.208446 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 636/1260] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:36 2022] GET /compute/v2.1/servers/81e28f7e-f8f3-4b0a-a707-793d663d1a9e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:37:36.255701 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:36.256322 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:36.262675 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:36.263113 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:36.263942 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:36.264355 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:36.380394 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-59f32499-5b04-4ce5-aed7-f38bb963f0b4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] Calling method '.version_select at 0x7f7e76dfd550>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:36.407036 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-59f32499-5b04-4ce5-aed7-f38bb963f0b4 tempest-TestShelveInstance-263631543 tempest-TestShelveInstance-263631543-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1299718019" status: 202 len: 0 microversion: 2.1 time: 0.029734 Jan 28 01:37:36.407744 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 637/1261] 10.222.0.16 () {58 vars in 1253 bytes} [Fri Jan 28 01:37:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1299718019 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 28 01:37:36.410741 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.policy [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116163) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:36.420653 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-a132f16d-0421-42ca-ae74-ca04405d4703 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1554 microversion: 2.1 time: 0.168128 Jan 28 01:37:36.421017 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 625/1262] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:36 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:37:37.436795 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:37.437400 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:37.443594 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:37.444039 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:37.444818 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:37.445641 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:37.781773 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:37.789446 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-9a8dec2e-584f-46e0-971a-8919e48c072c tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1554 microversion: 2.1 time: 0.356942 Jan 28 01:37:37.790030 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 638/1263] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:37 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:37:38.435263 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [req-292eda2e-9f7f-46fe-be5e-0a65a00c6ab9 req-5ad1d865-bc12-47ea-b32a-ed7ee9237034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef", "name": "network-vif-deleted", "tag": "64bd017a-e349-4294-8b50-45882cd1509b"}]} {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 28 01:37:38.437586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 28 01:37:38.437586 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: warnings.warn(msg) Jan 28 01:37:38.444628 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-292eda2e-9f7f-46fe-be5e-0a65a00c6ab9 req-5ad1d865-bc12-47ea-b32a-ed7ee9237034 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:38.447819 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [req-292eda2e-9f7f-46fe-be5e-0a65a00c6ab9 req-5ad1d865-bc12-47ea-b32a-ed7ee9237034 service nova] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:38.458436 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.compute.server_external_events [req-292eda2e-9f7f-46fe-be5e-0a65a00c6ab9 req-5ad1d865-bc12-47ea-b32a-ed7ee9237034 service nova] Creating event network-vif-deleted:64bd017a-e349-4294-8b50-45882cd1509b for instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef on hv-cinder-82662 Jan 28 01:37:38.463626 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [req-292eda2e-9f7f-46fe-be5e-0a65a00c6ab9 req-5ad1d865-bc12-47ea-b32a-ed7ee9237034 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031903 Jan 28 01:37:38.464767 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 626/1264] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Jan 28 01:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 28 01:37:38.807617 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:38.808244 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.compute.api [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116162) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:38.819114 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:38.820551 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:38.821712 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:38.822575 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:38.860200 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:38.860992 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG oslo_concurrency.lockutils [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116162) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:38.862152 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.objects.instance [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lazy-loading 'fault' on Instance uuid 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef {{(pid=116162) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 28 01:37:38.907439 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.policy [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9af2b19a4b09402b9fc4a945b3c646ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49054bd529dd4f6da0310f7fe1ef8f58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116162) authorize /opt/stack/nova/nova/policy.py:199}} Jan 28 01:37:38.915483 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-fd208e25-b788-4108-9531-ac0d10ade145 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 200 len: 1348 microversion: 2.1 time: 0.111607 Jan 28 01:37:38.926301 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 639/1265] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:38 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 1348 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 28 01:37:39.934083 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '>' {{(pid=116163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:39.935451 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.compute.api [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] [instance: 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef] Fetching instance by UUID {{(pid=116163) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 28 01:37:39.947332 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:39.947882 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:39.948789 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 28 01:37:39.949764 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG oslo_concurrency.lockutils [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Lock "839f0624-fa55-455e-8eb6-3b061d667ee0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 28 01:37:39.968797 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.wsgi [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] HTTP exception thrown: Instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef could not be found. Jan 28 01:37:39.969724 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: DEBUG nova.api.openstack.wsgi [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Returning 404 to user: Instance 1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef could not be found. {{(pid=116163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 28 01:37:39.970668 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO nova.api.openstack.requestlog [None req-99dbc0d3-de77-4909-b4ca-81007958d024 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef" status: 404 len: 111 microversion: 2.1 time: 0.041382 Jan 28 01:37:39.972184 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: [pid: 116163|app: 0|req: 627/1266] 10.222.0.16 () {58 vars in 1235 bytes} [Fri Jan 28 01:37:39 2022] GET /compute/v2.1/servers/1c245ddb-dfd8-4b60-bc16-b2e0b34c55ef => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 28 01:37:39.979629 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: DEBUG nova.api.openstack.wsgi [None req-b0d7de54-3622-4049-8ed4-0654713caf63 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] Calling method '.version_select at 0x7f7e76ddd3a0>' {{(pid=116162) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 28 01:37:40.022119 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO nova.api.openstack.requestlog [None req-b0d7de54-3622-4049-8ed4-0654713caf63 tempest-TestMinimumBasicScenario-2117024400 tempest-TestMinimumBasicScenario-2117024400-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2077068010" status: 202 len: 0 microversion: 2.1 time: 0.045570 Jan 28 01:37:40.023094 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: [pid: 116162|app: 0|req: 640/1267] 10.222.0.16 () {58 vars in 1271 bytes} [Fri Jan 28 01:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2077068010 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 28 01:38:23.472728 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:38:23.473817 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: Fri Jan 28 01:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:38:23.493601 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:38:23.494214 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: Fri Jan 28 01:38:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:40:22.999696 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:40:23.000369 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: Fri Jan 28 01:40:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:40:25.296046 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:40:25.296863 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: Fri Jan 28 01:40:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:40:41.232936 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:40:41.233674 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: Fri Jan 28 01:40:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:41:43.483163 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:41:43.483857 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: Fri Jan 28 01:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:41:43.502354 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:41:43.502852 dv-cinder-826623-2-iscsi devstack@n-api.service[116162]: Fri Jan 28 01:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 28 01:41:46.656533 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 28 01:41:46.657068 dv-cinder-826623-2-iscsi devstack@n-api.service[116163]: Fri Jan 28 01:41:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!